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Summary 


This  report*  considers  the  general  problem  of  detection  and  MMSE 
estimation  of  nonlinear  memoryless  functionals  of  random  processes. 

In  all  cases  considered,  the  observation  process  is  assumed  to  be  con- 
taminated by  additive  Gaussian  white  noise. 

A Volterra  functional  expansion  is  derived  for  the  likelihood  ratio 
used  in  the  detection  of  a nonlinear  memoryless  functional  of  a random 
process.  This  expansion  is  reduced  to  well  known  results  for  the  special 
case  of  detection  of  a Gaussian  process.  For  the  case  of  detection  of 
a nonlinear  memoryless  functional  of  a stationary  Gaussian  random 
process,  it  is  shown  that  the  likelihood  ratio  has  an  asymptotic  form  for 
which  performance  can  be  obtained  provided  the  nonlinearities  and 
processes  satisfy  Sun's  theorem. 

A Volterra  functional  expansion  for  MMSE  estimation  of  a nonlinear 
memoryless  functional  of  a random  process  using  nonlinear  observa- 
tions is  also  derived.  It  is  shown  that,  using  linear  observations,  the 
Volterra  expansion  reduces  to  well  known  results  for  the  case  of  MMSE 
estimation  of  a zero  mean  Gaussian  process.  A stochastic  differential 
equation  for  the  logarithm  of  the  likelihood  ratio  is  also  derived  to 
demonstrate  agreement  with  known  results. 

♦This  report  originally  printed  as  a dissertation  in  partial  fulfillment 
of  the  requirements  for  the  degree  of  Doctor  of  Philosophy  in  Electrical 
Engineering  in  the  Graduate  School  of  Syracuse  University,  May  1979. 
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DKTF.CTION  AND  MMSK  KST1MATION  OF  MFMOKYI  KSS  NON1.1NKAR 
I-TNl' TlOSAS.S  OF  RANDOM  IMUK'KSSF.S  IN  GAYSS1AN  WlllTF  NOISK 
1.  1 lilt rixluct  ion  .uni  Dissertation  t >ut lint; 

l lu>  theory  of  detection  and  minimum  mean  square  error  (MMSK)  estimation 
tor  known  signals  in  Gaussian  noise  and  for  Gaussian  processes  in  Gaussian 
noise  are  widely  available  | 1,2|  and  well  known.  This  is  due  to  <fhe 
successful  application  of  the  theory  in  solving  many  problems  of  practical 
interest.  F lie  nonlinear  theory  is  not  as  widely  known  due  both  to  a lack  of 
solutions  to  problems  of  general  interest,  and  to  the  mathematical  background 
required  to  follow  many  of  the  proofs  (which  rely  on  measure  theory  and  the 
stochastic  calculus).  Recently,  several  texts  |,‘l,-l|  have  appeared  to  make  the 
nonlinear  theory  more  available  to  the  average  engineer. 

In  this  dissertation,  the  Karhuenen-l.oeVe  expansion  and  the  Yolterra  func- 
tional expansion  arc  used  to  derive  results  for  detection  and  MMSK  estimation 
tor  nonlinear  memorvless  functionals  of  random  processes.  In  all  cases  con- 
sidered. the  observation  process  is  assumed  to  contain  an  additive  Gaussian 
white  noise  component.  Since  the  results  are  shown  using  simple  concepts,  thev 
can  be  easilv  followed  In  most  graduate  students  with  no  background  in  measure 
theory  or  the  stochastic  calculus. 

In  Chapter  U,  a Yolterra  functional  expansion  for  the  likelihood  ratio  is 
derived  for  detection  of  a nonlinear  memorv  less  functional  of  a random  process . 
For  the  special  case  of  detection  of  a zero-mean  Gaussian  process,  this  Yolterra 
functional  expansion  is  reduced  to  well  known  results.  Two  examples  of 
calculating  Yolterra  kernels  for  detection  of  nonlinear  memorvless  functionals 


j 


l-l 


of  zoro-moan  Gaussian  piwesst's  are  presented.  Detection  of  nonlinear 
memory  less  funetionals  of  tie  processes  is  considered,  and  performance  of  the 
truncated  Volterra  expansion  compared  with  the  optimum  performance  for  a 
phase-modulated  sinusoid.  For  long  observation  times,  a class  of  non- 
linearities  and  stationary  Ciaussian  processes  is  considered  for  which  it  is 
possible  to  reduce  the  Volterra  functional  expansion.  As  an  example,  it  is 
shown  that  first  order  Butterworth  phase  modulation  of  a sinusoid  is  a member 
of  this  class.  Performance  is  derived  for  this  example. 

In  Chapter  111,  MMSK  estimation  of  a nonlinear  niemorvless  functional  of 
a random  process  using  nonlinear  observations  is  considered.  Using  Haves’ 

I 

law  and  the  Karhunen-l.oeve  expansion,  an  expression  for  the  aposteriori 

I 

probability  densitv  function  qxlfl  of  the  coefficients  of  the  Karhunen-l.oeve 
expansion  of  the  random  process  is  obtained.  Using  this,  a Volterra  functional 
expansion  is  given  for  the  MMSK  estimate  of  a nonlinear  memoryless  functional 
of  the  random  process.  For  the  special  case  of  MMSK  estimation  of  a zero- 
mean  Gaussian  process  using  linear  observations,  the  Volterra  expansion  is 
reduced  to  well  known  results.  Also,  for  the  case  of  MMSK  estimation  ot  a 
nonlinear  memoryless  functional  of  a zero-mean  Gaussian  process  us iryfcUnear 
observations,  the  Volterra  functional  expansion  is  shown  to  reduce  to  reswhsr 
obtained  In  Olsen  { 5 ] . The  connection  between  MMSK  estimation  and  detection 
theory  is  shown  by  using  the  Volterra  functional  expansion  to  derive  a stochastic 
differential  equation  for  the  logarithm  of  the  likelihood  ratio.  Phis  result  was 
obtained  by  Kailuthl  G | using  the  Ito  stochastic  calculus.  Systems  of  differential 
equations  describing  the  MMSK  estimate  of  a Gaussian  first  order  Butterworth 
process  with  linear  observations  and  the  square  of  a Gaussian  first  order 
Butterworth  process  with  squared  observations  are  obtained.  MMSK  estimation 


of  dc  processes  is  considered,  and  as  an  example,  MMSK  estimation  of  the  dc 
phase  of  a sinusoid  is  presented  along  with  performance. 

Chapter  IV  is  a summan  of  the  principal  results  of  the  dissertation  and 
suggestions  for  future  work. 

1 . 1’  Previous  Kesults  in  IVtcction  and  MMSK  Kstimation  for  Nonlinear 

Problems 

Systems  of  coupled  nonlinear  differential  equations  for  the  conditional 
moments  of  a random  process  were  first  rigorously  derived  by  Kushner(7|  . 
Development  of  these  equations  was  preceded  bv  the  formulation  of  a partial 
differential  equation  for  the  a posteriori  pdf  of  the  state  of  a random  process 
(known  as  Kushner's  equation),  also  derived  by  Kushner|s|  and  later  by 
Buev  | ;t|  . An  excellent  presentation  of  this  theory  is  given  in  Jazwinskil  ;i|  . 
Kushner's  equation  must  be  interpreted  formally,  since  there  is  no  theorv  for 
stochastic  partial  differential  equations.  The  equations  for  the  moments, 
however,  have  been  rigorously  established  by  Kushner.  Unfortunately,  this 
system  of  equations  is  infinite,  and  there  does  not  appear  to  be  any  convenient 
wav  of  solving  them.  Jaz.vvinski  has  suggested  several  approximation  techniques, 
such  as  truncating  the  system,  or  assuming  a recursion  between  the  moments 
(such  as  a Gaussian  recursion)  so  that  the  system  may  be  closed 1 3]  . Some 
simulation  results  are  available  in  the  literature.  Kushner)  10)  , for  example, 
successfullv  simulated  a Gaussian  tvpe  filter  on  a nonlinear  second  order 
system  with  linear  measurements.  These  filters  are  not  used  as  extensively 
as  the  linearized  or  extended  Kalman  filter)  B ) . and  so  there  are  not  many 
simulation  results  available. 


Another  approach  that  appears  promising  for  the  discrete  filtering  of 

K _ i 

Markov  processes  is  based  upon  Bayes'  law.  Let  Z denote  the  sequence 
of  data  Zq.  Z^  j.  Using  Bayes'  law|  11]  , the  ajwsteriori  pdf  of  the  state 

of  a random  process  is  given  by 


P(Xk!zK) 


p('xkizK-1J  ^v-v 
p(zkIzK'') 


(l-D 


P(XKIzK'1)  - /P(XK-llzK'1)  P«KIXK-l>dXK-l  (1-2» 

P(V ZK''J  * /‘’fV2"'1)  P<ZKIXK,dXK  O-3* 


where  the  state  X^.  evolves  according  to  a nonlinear  difference  equation 


x = r (X  w ) 
k k'  k -v  k - r • 

and  the  measurement  data  is  given  by 


ZK  = hK(XK’  VK)  ' 


(1-4) 


(1-5) 


and  where  W _ ^ and  V^_  are  uncorrelated  Gaussian  white  sequences.  In 
Sorenson]  11]  . the  a posteriori  (xlf  in  Equation  (1-1)  is  approximated  as  a 
multivariate  Gaussian  density.  In  Hecht|  12]  , multidimensional  Gaussian 
quadrature  is  used  to  perform  the  integrations  in  Equations  (1-2)  and  (1-3) 
and  provide  a very  close  approximation  to  the  evolution  of  the  a posteriori  pdf. 
These  ideas  are  extended  in  Buev,  et  al.  ( 13]  and  simulation  results  reported. 
The  technique  appears  to  be  very  promising  even  though  the  computational  load 
is  heavy,  even  for  problems  of  low  dimension. 

Other  techniques  for  MMSE  estimation  include  the  partitioning  theorem 
of  1-iiniotisl  11|  and  the  Volterra  approximation  of  Katzenelson  and  Gould|  15]  . 
I^tiniotis  obtains  a Baysian  relation  for  the  a posteriori  i>df  of  the  state  via  his 


i 


partitioning  theorem.  Kat /enelson  ami  Could  derive  systems  of  integral 
equations  to  Ih>  solved  to  obtain  the  N’*'  order  Volterra  filter  which  mlnimi/es 
the  mean-squared-estlmatlon  error.  I'o  the  best  of  the  author's  knowledge, 
neither  technique  has  resulted  In  MMSK  estimators  for  problems  of  general 
into  rest. 

More  recently,  Olsen|h|  has  obtained  exact  results  for  MMSK  estimation  of 
a nonlinear  memorylcss  functional  of  a Causslan  process  In  llaussinn  white  noise 
using  linear  observations. 

I’he  connection  between  detection  theory  and  MMSK  estimation  was  first 
discovered  by  Sehweppe|  lti|  for  i lauss tan  processes  in  (iaussian  white  noise  and 
Sosulln  a ltd  St  ratonov  ich|  17 1 for  detection  of  a diffusion  process  in  liaussian  white 
noise.  IHmcanl  ts|  later  rigorously  rederived  t ho  work  of  Sosulin  and  Stratonovich 
using  the  Ito  interpretation  of  the  stochastic  integral.  Kailathl  (>|  later  generalized 
these  results  to  a larger  class  of  random  piuccsses  using  tile  Ito  stochastic  calculus. 
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CHAPTER  11 


DETECTION  OF  NONLINEAR  MEMORYLESS  FUNCTIONALS  OF 
RANDOM  PROCESSES  IN  GAUSSIAN  WHITE  NOISE 
2.  1 Derivation  of  the  Volterra  Series 

This  paragraph  considers  the  problem  of  detecting  a nonlinear  memoryless 
functional,  A S(t, ' ),  of  a random  process,  m(t),  in  additive  Gaussian  white  noise 
n(t).  Using  the  Karhunen-Loeve  expansion,  a Volterra  functional  expansion*  is 
obtained  for  the  likelihood  ratio. 


Consider  the  detection  problem 


Hr 

r(t>  = 

A S[t,  m(t)l  + n(t) 

0 s 

t s 

T 

(2-1) 

Ho: 

r(t)  = 

n(t) 

0 - 

t s 

T 

(2-2) 

where  n(t > 

is  a zero  mean  Gaussian  proce 

ss  and 

m(t) 

and  n(t)  are  independent 

processes 

with  e 

ovariance 

K (t 
mv 

1 ’ *2^ 

= E((m(t1)  - E[m(t1»  } 

(m(t2 

,)  - E 

:(m(t2)l}) 

(2-3) 

No 

K (t, 
nv  I 

[» 

= Kfnft n(t.,)I  = — 

(5(tj  - 

t2) 

(2-4) 

Suppose  th; 

it  m(t)  has  the  Karhunen- 

Loeve 

expansion 

N 

m(t) 

= L.I 

N- 

ivtj  4>j(t) 

0 =£ 

t s 

T 

(2-5) 

i = 1 

where  the  i 

’igenfunctions,  </>.( t),  and  eigem 

.allies, 

V 

are  solutions  of 

X <i> 
i M 

(t)  = 

1 

/ Km(t’  T)^x(T)dT 

(2-6) 

o 

and  where 

T 

m.  = 
i 

/ 

m(t)  4>j(t)  dt 

(2-7) 

o 


♦A  functional  is  a mapping  from  the  observation  space  (r(t);  0 ^ t ^ t)  to  the 
real  line.  The  Volterra  functional  expansion  is  the  functional  analog  of  the 
Taylor  series. 


Consider  the  truncated  representation  of  m(t) 


'n*1'  = S mi  V' 


and  consider  the  hypothesis  testing  problem 

H.:  rN(t>  = A S[t,  mN(t)l  + n(t)  0 v t s T 


»0:  rN(t)  = n(t' 


(2-10) 


Note  that  the  m.,  i = 1 , 2,  . , N may  bo  thought  of  as  unwanted  parameters  with 

probability  density  function  p(m^ , . . . , mN). 

To  obtain  the  likelihood  ratio  for  the  hypothesis  testing  problem  of 
Equations  (2-1)  and  (2-2),  the  likelihood  ratio  for  the  hypothesis  testing  problem 
of  Equations  (2-!))  and  (2-10)  will  first  be  obtained.  Then  the  likelihood  ratio  for 
Equations  (2-1)  and  (2-2)  will  be  determined  by  taking  the  limit  as  N — JO,  Note 
that  Equations  (2-9)  and  (2-10)  represent  a composite  hypothesis  testing  problem 
where  the  probability  density  function  (pdf)  of  the  unwanted  parameters  is  p(nij, 

, mN).  For  this  type  of  problem  [1,  p.  87]  , the  likelihood  ratio  is 


S p(R  I 0,  11  ) p(0  | ||  ) dfl 

A (R)  = — — z - 

/ p(R  I 7,  H ) p(0  I H ) d 0 


(2-11) 


where  It  is  a random  observation  vector  and  0 is  a vector  of  unwanted  random 


parameters.  To  pose  the  problem  in  a form  where  Equation  (2-11)  can  lx?  used, 
r^(t)  is  expanded  in  a Karhunen-Eoeve  expansion  (under  the  assumption  m(t)  is 
given)  in  the  set  of  orthonormal  basis  functions  t/yt),  i = 1 , ... 


whe  re 


</-j  (t  > = 


s ''  mi  V 


0 ~ t T 


1 IN 

J '•£ 


<*>,(( ) dt 


(2-12) 


•••  •*■>“"  arbUrarily  to  complete  .he  ,«  of  basis  fu„c(.o„8. 

The  expansion  is 


V"  - r „ «, 


M—  t ’J' 

j = 1 


where 


rj  - J rNfl>  ( dt  . 


Now  define 


(2-13) 


(2-14) 


rN,  M(t)  = rj  i/’.(t) 

i = l 


and  form  the  hypothesis  testing  problem  (given  m, ny 

‘ 'I' 

Pi  1 f \Aslt,  n\N(t)|  t-n(t)}  j/- j (t ) dt 


"r  R 


i 

f 'ASIt,  m 
J N 


(H)  f n(t)}  ^^(t)  dt 


(2-15) 


(2-1(5) 


n(t) 


H0:  K 


M 


i 

/ 


T 

/ 


n(t)  t!>„(t)dt 


(2-17) 


rht>  exacted  value  of  r.  conditioned  on  hypothesis  U and  on  m .....  m 

1 1 ' ' ’ N 

is  ni vcn  by 


K(rj  I Hj.  nij mN)  = k/a  j 


S“|t.  mN(t)l 


T 


T 


j S“(t,  mN(r)l  dr 


— r dt  + f n(t)  i/ijft)  dt 

1 J i 


T 


= A 


S~(t,  mN(tlI  dt 


(2-18) 


and,  for  l > i 


*•-(**!  I •*1.  nij mN>  = E /a  J S|t,  mN(t)l  tf^t)  dt  + J 

' O n 


n(t)  dt 


(2-19) 


However,  since 


S|t,  mN(t)| 


T 


/ 


S“|t.  mN(t)|  dt 


ifj(t) 


(2-20) 


and  f^jft)}  forms  an  orthonormal  set,  it  follows  from  Equation  (2-19)  that 

K<ri,nr  mi <V  = 0 1 ' 2 • (2-21) 

Similarly 

^' (' j I H(),  m j , . . . , nij^)  = o i — 1 . (2-22) 


2-4 


Cancelling  ( , NQfM  2 exp  ( - J-  £ r 2 L of  the 


numerator  and  denominator  in 


Equation  (2-251,  taking  the  limit  M — ■»  and  intem-iMn«r  o i 

n integrating  the  denominator  results 

Atr(t>]  - Urn  ^ J.Njexp/lA  j r(t)  S[t,  mN(t)]  dt  j 
- JO  ' o / 


W~  j s“It*  niN(t)]dt)  pfnij  ...  mN)  dnij  ...  dmN  (2-261 


which  can  lx*  rewritten  in  the  form 


X[r(t>1  = [}“  . J /-”/exP  jjf  j S'1*  mN<t'l  (rd)  - f Sit,  mN(t)l) 


P j * • • • i oi dm  j ...  dm^  | • 

Kxpanding  the  first  exponential  in  Kquation  (2-261  yields 


(2-271 


T T 


A[r(tl|  = 


X)  IT  (w)  (•••  f - r<V  V dtj  ... 

i = 0 ° o o 


(2-281 


where  the  integrand  contains  the  Volterra  kernel  f (t  ...  t 1 

i 1 i 


f l (l  1 » •••*  t ^ 


1 " !£„  mN(,l11--  - Sltl*  >*,'1 


exp  N~  / S“l  T,  mN(T)l  dT 


P(mr  ....  mNl  dnij  ...  dmN  • 


(2-291 


lotting  N— ■ '*  in  Equation  (2-29)  fj (t ^ , t.)  becomes 
ft  ! lj)  = k/sUj,  mitj)!...  Sltj,  m(tj)]  exp/-  j S“|r,  m(T)]  dr  ^ j 


// 
(2-30) 


where  the  expectation  is  carried  out  with  respect  to  the  random  variables 

T 


m(t  j)  . . . , m(tj)  and  exp 


xp  J S“IT.  ni(T)l  drV  E> 


m(T)l  dr  J.  Expanding  the  exponential 


in  Equation  (2-30),  1.(1^  . . . , t.)  can  also  be  written  as 


T T 


fjd j.  •••*  1 


t’  * E (l T1)'  $ J sf  Vi  •••  si4 

j = o o o 


dti+l  •”  dti+j  (2-31) 


where 


SK  = SltK,  m(tK)l  . 


Summarizing,  the  likelihood  ratio  of  the  hypothesis  testing  problem  of  Equations 
(2-1)  and  (2-2)  is  given  by  the  Volterra  functional  expansion  of  Equation  (2-28) 
with  the  Volterra  kernels  defined  by  Equation  (2-30). 

Note  that  Equation  (2-28)  is  a physically  realizable  nonlinear  operation 
with  memory  on  r(t).  It  is  easily  put  in  the  form 

JO  JO  JO 


A[r(t)l 


E /••*•  / 

i = n - -®  _ 


. . . r(T  - tj)  Fjftj tj)  dtj  . . . dtj 


r(V  - tj) 


where 


*i(tr 


V 


TT 


W 


V 


U(tj) 


U(tt) 


(2-32) 


and  U(t)  Is  the  unit  step.  Also,  each  kernel  f^(t ^ , t^)  is  symmetric  in  its 
arguments. 


2.  2 Hederivation  of  the  Linear  Result  for  Zero  Mean  Gaussian  Processes 
Consider 

A Sit,  m(t)l  = m(t)  (2-33) 

where  m(t)  is  a zero-mean  Gaussian  process  with  autocovariance 


Km(tl*  ‘2'  = E[m<V  m(t2)1  - (2-34) 

For  this  case,  the  hypothesis  testing  problem  of  Equations  (2-1)  and  (2-2) 
becomes 


H : r (t)  = m(t)  + n(t) 


H0:  r(tt  = n(t) 


0 £ t 25  T 
0 i t ^ T 


(2-35) 

(2-30) 


where  m(t)  and  n(t)  are  independent  zero-mean  Gaussian  processes.  From 
Equations  (2-28)  anil  (2-30)  the  likelihood  ratio  is 
JO  T T 

Alr(t)l  = H (if")  /•••  / t^dtj...  dtt 

1 = 0 o o (2-37) 


o o 


* 


where 


Equation  (2  -42 ^ may  bo  rewritten  as 


1 


The  N-fold  integration  is  recognized  to  be  unity  since  it  is  the  volume  of  an  N 
dimensional  density  function.  Taking  the  limit  in  Equation  (2-431  it  follows  that 


f 

o 


77" 

i = 1 


N 


(2-441 


In  the  ensuing  development  it  is  shown  that  f. (t  1.  . . t.)  = 0 for  i odd.  Pro- 

ceeding with  f.,(t  , t.,1, 


f2<tj,  t2>  = F. 


mitji  m(t.,l  exp 


T 


-if  / 

o J 


m“(T  1 dt 


(2-451 


Expanding  m(t^l,  m(t.,l  and  m(rl  in  Karhunen-Loeve  expansions,  there  results 


f2(tr  V 


00  oc 


■ E E 

i = 1 i - 1 


(2-461 


10 


la  Kquatlon  note  that 


From  Equations  (2-51)  and  (2-50) 

^4^1»  ^2’  ^3*  ^4^  = 


00 

_ N /2 

IT  ° 


N 


i=l  -“  + X, 


2 i 

r 00  x . 


2 2 

XT  \ “ 


X. 


i /v  • 

ZnT^-  Vl2>  E 55~ L‘ 

£=*-#♦  *i 


V^V4’ 


°°  x. 


x. 


E ir^-  (*3>  E fr-^ 


%‘V 


X. 


+ E N^-1-  +i1<tl»  \(,4>  E iT^ 

ii  = 1 -r+  i„  = i -£+  x 

^ X1  2 2 i 


»l2(t2»  V*3> 


(2-52) 


From  Equation  (2-52)  note  that 
T T T T 


r(V  r(t2)  r(V  rh]  f4(tl’  *2’  *3’  V dti  dt2  dt3  dt4 


T T 


, 2 


/ / r<tJ)r<y  E n — ♦)*!>  +/2>  *1 dt 


o o 


j=1  ~r+  Xj 


(2-53) 
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r 
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2-13 


■■■  I 


Generali/lnK*  from  Kquatlon  (2-53)  obtain 
T T 

J A.  j r(t1>  — r(tt>  ft(tj tt)  dtj  ... 


»lt. 


o o 


f 


o t : 


OX  2 


"j  '•*  t 

•>l  “ _L  » 


T T 


-ii/2 


J J r(ti)r(t2)  ^ N ^ ^J(t1>  4*J(t2>  dt  l dt2 


o o 


i - i -rf  + * 


for  1 evon 


for  i odd  . 


(2-54) 


From  Fquations  (2-54),  (2-44)  and  (2-37)  tho  likelihood  ratio  is  found  to  be 


Alt' (t  )1 


— — N /2 

IT  ° 


N 

i=  1 -E  f 


t r 


E^y 


1 = 0 

l even 


(l  2 


-i  l ^2 


j j ''V'V  E KT7— ^ WW"1! 


dt 


j=  1 T>-  *■  * I 


(2-55) 


* l'his  follows  from 


,:<m, 'V 


EK(m.  m ) . . . K(m,  m ) 
, ,,*1  2 ‘N-l  *N 


where  the  sum  is  over  all 


0 i odd 

n: 


i even 


■N/L'(^)'. 


ways  of  dividing  the  N 


random  variables  into  tv  eombinations  of  pairs  and  where  K(m.)  = 0 for  i=  1, 
....  N.  See  |1,  problem  3.  3.  121 , 


2-14 


■■ 
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Redefining  the  index  of  the  summation  on  i in  Equation  (2-55)  the  expression 
for  A[r(t)|  becomes 

T T 


A (r(t)I  = 


__  N 72 

7 T 0 


N 

1=1  -T  f xi 


exp 


\ 

W j f r(tl)r(t2)X^  N ^ 

o J J o . 


o o 


j=l 

J •>  i 


<t>.(t2)  dtj  dt2 


(2-56) 


The  series  in  Equation  (2-56)  is  recognized  as  the  solution  to  the  integral  equation  ( 1] 

T 

») 


N r 

-f  h*(tr  t2)  + J h*(tr  r)  Km(T,  t2)  dr  = Km(tr  t2)  • (2-57) 


o 


Therefore, 


Mr  t2)  = ^2  N ^ Vl*  • 


(2-58) 


j=l  ir+  X 


From  Equation  (2-56)  and  (2-58),  the  logarithm  of  the  likelihood  ratio  is  given  by 
T T -*> 

In  A (r(t)l  = ± f f rflj)  r(tg)  h*^,  tg)  dtj  dtg  M1  + TT7  • 

° „ „ “ . , o' 


o o 


i = 1 


(2-59) 

This  is  in  agreement  with  known  results  (1,  p.  12,  Equation  (2-26)1  . 

2.  3 Calculation  of  Volterra  Kernels  - Some  Nonlinear  Examples 

In  this  paragraph,  three  examples  of  computing  Volterra  kernels  are  pre- 
sented, The  first  two  examples,  a hard-limited  Gaussian  process  and  the  absolute 
value  of  a Gaussian  process,  are  the  only  nonlinearities  of  Gaussian  processes  dis- 
covered to  date  for  which  exact  calculation  of  the  first  three  kernels  is  possible. 
The  last  example  compares  the  performance  of  a receiver  based  on  the  likelihood 
ratio  with  the  performance  of  a receiver  based  on  the  truncated  Volterra  expansion 

of  the  likelihood  ratio  for  a nonlinear  memoryless  functional  of  a D.C.  process. 
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2.  3.  1 Hard-Limited  Gaussian  Process  In  Gaussian  White  Noise 


Consider 

S[t,  m (t ) 1 = sgn[m(t)l  = 

1 

m(t)  > 0 

= 

0 

m(t)  = o 

= 

-1 

m(t)  < 0 

(2-60) 

where  m(t)  Is  a zero-mean  Gaussian  process.  From  Equations  (2-281  and  (2-301 


A I r (t  1 ] = ^2 

l = o 


r(tj)  . . . r(tj)  fj (t 2 , . . . , tj)  dtj  . . . dtj 

(2-01) 


who  re 


f|(t  r 


/ ( a2  7 

E sgnlm(tj)l  . . . SRnlmdjl]  exp  I 


sgn“|m(Tl]  dT 
(2-62) 


From  Equations  (2-62)  and  (2-60) 

= * (2-63) 

Also,  since  sgn(m(t)l  is  an  odd  function  of  m(t) 

f I (t  j > = fQ  E{sgnlm(t))  } 0.  (2-64) 

Similarly, 

f2(ti»  = fQ  KlsgnlmCtj)]  SKn|m(t.,)l)  • (2-65) 


" 2 7 

A f 2, 

f = K ( 

o ' 

| exp 

-jj-  I s£n“lm(T)]  dT 

o J 
o 

The  expectation  in  Equation  (2-65)  is  given  in  [ 19.  p.  198,  Equation  7-29  ] to 
obtain 


f2(V  9 ■ f»  ir  sln"1 


Km(V  V 


"I’  “m'l2*  '2’ 


t,l  K <t.„  t„) 


(2-66) 


where  K (t^,  t9)  is  the  autocovariance  of  function  of  m(t).  Also 

f3(tl*  l2*  t3)  = f0  K { SKnlmftj)]  sgn|m(t2)l  sgn(m(t3)]}  = 0 (2-67) 

and  fj(tj,  . . . , t.)  = 0 for  i odd.  The  general  expression  for  f ^ (t ^ , . . . , t^ ) for 


i even  appears  to  be  intractable.  An  interesting  integral  expression  is  available 
in  [20] 


E[sgn(m 


l...mN)l  N /”•/ 


CO  ) 
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dw  ...  dco 
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_ oO  —JO 


N co  co 

1 * * N 


(2-68) 


where  . . . , u>N)  is  the  joint  characteristic  function  of  irij,  i = 1,  . . . , N. 

This  expression  is  not  available  in  reduced  form  for  N > 4. 

From  Equations  (2-61),  (2-63),  (2-64),  and  (2-66),  it  follows  that 
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(2-69) 
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2.3.2  Absolute  Value  of  a Gaussian  Process  In  Gaussian  White  Noise 


Consider 

Sit.  m (t ) 1 = Imft)1  (2-70) 

where  m(t)  Is  a zero-mean  Gaussian  process.  Also,  assume  A = 1 to  obtain  from 
Equation  (2-28)  and  (2-30) 

, T T 


Mr(t)l  = ±(f-j  Jlf  rdj)...  rdjjfjdj *,)  cit,  . ..  dt 

1 = 0 O O /.). 


(2-71) 


whe  re 


ft(tr  ....  tt)  = E ! I m(tj)  . . . m(tt)|  exp 


T 
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I m(T)  I"  dT 


(2-72) 


Note  that 
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| lm(r)l“dr  = f m“(T)dr 


(2-73) 


Hence,  expanding  m(T)  In  a Karhunen-Loeve  expimslon  whore  the  pdf  of  the 
expansion  coefficients  Is  given  by  Equation  (2-41),  f becomes 
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(2-74) 
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With  reference  to  the  development  of  Equation  (2-44),  Equation  (2-74)  can  be 
written  as 
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To  proceed  it  is  convenient  to  define  the  random  variable 
N 

,1 


zin  = J2  miW 


(2-77) 


i = 1 


where  now,  from  Equation  (2-7(5),  nij,  1=1,  ....  N are  zero  mean  independent 

N 

_£  A 

2 i 

Gaussian  random  variables  of  variance  — . Thus,  / is  zero-mean 


N 


IN 


■t  \. 


Gaussian  with  variance 


IT  r 


M N 

N o 

£ tr— L *i”«i> 


Z)M  N 

1N  1 = 1 + X 


(2-78) 


N 


2- IS) 


r 


From  Equation  (2-76)  through  Equation  (2-78) 

i 


N 


VV  ~ llmj7T  n_ 


N- 


E(IZ1MI)  . 


(2-79) 


1=1  T f Xl 


From  Papoulls  [19,  Equation  (5-48)] 


K('zin"  ■ iT” I 


(2-80) 


IN 


Utilizing  Equation  (2-58)  In  Equation  (2-78),  fj(tj)  may  he  expressed  as 


W ■ 


/ * N /2  \ ' (TT 

7T  s-2 — I 

V-*  T*»J 


11.(1,,  t,) 


(2-81) 


Similarly,  note  that 


N 


f2(tr  = 


N /2 

„n,  7T  »• 


00  o 


N 


N 


li=l  “T"  + X, 


/•*/ 


N 


E-iw 


i= i 


N 


E 


i 4*  i (t  2 )| 


i=  1 


JO  _JO 


v N 
N o . 

,N/2/ — 2 l 


<2">  TTw 


i-i  -?  * », 


exp 


\ 


m. 


N 


dm ....  dm 


N • 


1=1  “if  xi 


N 

o , 
~ f * 


(2-82) 


l! 


1 


y 


‘ 


1 
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As  with  Equation  (2-77)  define  the  zero  mean  Jointly  Gaussian  random  variables 
N 


lim 


■E 

(2-83) 

i = i 

N 

E 

mi  • 

(2-84) 

i=i 

have  the  property  that 

•> 

lT  Z IN 

N 

= -J-  M,.  tj) 

(2-85) 

N 

°z  2 

2N 

~ 2 

(2-86) 

k<z,n 

N 

Z2n'  " ~2~ 

(2-87) 

IN  ftnd 

Z>M. 

/ N N /2 

V ■ IllJTT 

• li-1  ► X, 


h(,ZlN  Z2N*' 


From  Papoulis  f 19.  p.  221,  Equation  (7-109)  and  Equation  (7-110)] 


(2-88) 


K(IZlNZ2Nh  = f aZ  °Z 

1 \)  •* 


IN  2N|  f rZ...  ff5 


K(Z1N  Z2n' 


Z 7 
IN  /'2N 


f -(Z1N  Z2N-'  . -1  ^ZIWy 


°z  az 

IN  a2N 


lTz  ffz 

IN  ^ 2N 


(2-89) 


2.  3.  3 A IV  Example  - Phase  Modulated  Sinusoid 

For  the  de  case,  the  sample  functions  are  random  variables.  Hence, 
m(t)  = m 0 ^ t s T . (2-92) 

From  Kquat ion  (2-28)  and  Kquation  (2-30),  the  likelihood  ratio  is  given  by 
oo  } T T 

\|r(t)l  = ^2  IT  (fr)  /•••/  r(tt)  f1(t1 t^dtj...  dtj 

i = O ° O o 

(2-93) 

where 


tj)  = k 


/ ao  fr  ^ 

|S(tj.  nt)...  S(tj,  m)  expj  - — I S2(r,  m)  dr 

1 • /J 

(2-94) 

Observe  that  the  Karhuncn-Loevc  expansion  of  m(t)  consists  of  a single  term. 
Hence  another  expression  for  the  likelihood  ratio  is  obtained  from  Kquation  (2-20) 
as 


A l r (t ) 1 = I exp 


/ 


T 


T 


ijjf-  f r(t)  S(t,  m)  dt  - f S2(t, 

O J o J 


m)  dt 


p(m)  dm 

where  p(m)  is  the  a priori  pdf  of  m. 
U*t 


(2-95) 


S(t,  m)  = cos(u>  t f m) 
o 


(2-90) 


where 


Ptm)  = — 


O'-  m 2 ir 


0 


elsewhere 


(2-97) 


From  Equations  (2-951  through  (2-971,  the  likelihood  ratio  for  this  problem 


is  given  by 

Mr  (til 


T 


T 


= TT  f expl^-  J r(tl  co8(u>ot  + mldt  j 


Let 


T 


■/ 


r(tl  cos  ^ t tit 
o 


eos"(u>  t + ml  dt 
o 


(2-98) 


dm. 


(2-99) 


Q 


1 

■/  " 


(t)  sin  j t dt 
o 


(2-100) 


Then  Equation  (2-98)  can  be  written  as 

Until 


exp 


2 A 


A“T 

— (I  cos  m-Q  sin  ml  - — — 

o o 


sin  2u>  T cos  2 to  T - 1 

1 + — 77, — eos2m  s — — ^ sin  2m 


2«  T 
o 


2uj  T 
o 


dm 


(2-1011 


For  u)  T > s 1 the  second  term  in  the  argument  of  the  exponential  in  Equation 
(2-101)  reduces  to  a constant  independent  of  m and  may  be  lumped  with  the 
threshold.  When  this  approximation  is  not  made,  note  that  Equation  (2-101) 
can  tx>  rewritten  as 


A“T 


Mr  (t  i 


2N  2 n | 

° r 2A 

— — J exp  — (l  cos  m - Q sin  m) 


^2  sin  vj  T 

-rr: — rr! r — COS(2m  + uO  T) 

2N  u)  T ' o 

o o 


dm 


(2-102) 


2-25 


From  1 22,  Equation  (9,6.34)) 


7.  cos  0 = j (Z)  + 2 lk(Z)  cos(k  6)  . 

k=  1 


o 


It  follows  that 


A~  T 
2N 


•Mr  (t)| 


f , (.  Ail  ^Sll 
J H 2No  "oT  / 


exp 


I2A 

tr  (l  cos  m - Q sin  m) 
u° 


sin  T 

l o 


k=  1 


2N  ->  T 
o o 


r.>  % 1 

exp 

(I  cos  m - Q sin  m 

cos(k(  2 m + u)^T)l  dm 

o J 

Note  that 


I 


o 


(I  cos  m - Q sin  m) 


cos[k(2m  + ■’  T>]  dm 


2 n 


cos  T I 

o 1 

exp 

”-,A 

(I  cos  m - Q sin  m) 

«/ 

o 

‘ o 

2 it 

r 

’°A 

sin  kw  T 1 exp 

^ J 

(Icosm  - t^sinm) 

o 

o 

cos  2 km  dm 


(2 


26 


-103) 


dm 


-104) 


sin  2 km  dm  . 


(2-105) 


From  [23,  Equations  (3.  937-1)  and  (3.  937-2)] 


In  polar  form 


T 


(1  - JQ)21' 


(l-)c»)2k  - (I2  t Q2|k  e*)2k  ,"n‘1(Q/I) 


(2-109) 

(2-110) 


hxpresslng  coskco^T  and  sin  k as  sums  of  exponentials  and  making  use  of 
liquations  (2-109),  (2-110)  it  follows  that 

(I  - jQ)J'  (cos  kuj^T  - j sin  I<coqT)  4 (I  + j Q) “k  (cos  kco^T  f j sin  kco  T) 


= 2(1"  4-  Q")k  cos  (2k  tan-1  y-  + ku  T) 

l o 

From  Kquattons  (2-111)  and  (2-108) 


(2-111) 


/ 


exp 


2A 

(I(i  cos  m - Q sin  m) 
o 


cos  (k (2m  + u>  T)|  dm 


2 n I, 


Ik 


i 

•) 


2A  2 

r- (l  f <*  > 


cos  ^ 2k  tan  ‘ ^ + kw  t\ 


(2-112) 


for  k r o,  1,  2 

Substituting  Kquation  (2-112)  into  (2-104)  the  expression  for  the  likelihood  ratio 


becomes 


A"T 

~2N 

A [r  (t)  1 = e ° 


sin  u>  T 

, 

i /-£J- 

o 

■o 

2A  2 ■>  l 

N~  (l  + W ) 

o l 2N 

co  T ) 

v o 

o / 

o 

2 £ 


. 2,„  sin  u T 1 
A 1 o 

’N  co  T 
o o / 


cos 


k = 1 

k(co  T + 2 tan-1  ^ 


2k 


2A  2 2 * 

N~  (I  +Q  1 


(2-11.1) 


I 


I 


i 

1 

l 


2-28 


o 


1,  Equation  (2-113)  simplifies  to 


Note  that  for  co  T = nir,  n ^ 0 or  for  co 

o ’ 


9 

_ A"T 
~ 2N 

A [r(t)l  = e ° I 


i n 

2A  2 2 i 

(I 

o 


(2-114) 


This  Is  in  agreement  with  a previously  published  result  1 1 , liquation  (3(17)] 
The  performance  using  liquation  (2-114)  is  also  documented  (1,  p.  34(1]. 
Now  consider  liquations  (2-93)  and  (2-94) 


f = K 
o 


exp 


T 


A“  C •> 

- I cos  (co^t  + ni)  dT 

n J 


/ 


= ii 


exp 


•> 

A"T 

2N 


sin  co  T 

1 + — — cos(2m  + co  T) 

co  T ' o 

o 


(2-115) 


From  liquations  (2-115)  and  (2-97' 


A2T 

2N 


1 ir 


f = e 
o 


exp 


^2,.,  sin  co  T 

Trrf—  rr — cos (2  m + w T) 

2N  co  1 o 

o o 


dm  . 


This  Involves  a well  known  integral  |22j  . Consequently, 


9 

A“T 

~ 2N  ( ,2.„  sin  co  t' 

e o . ( A I o 

f = e I I - ttTt — rr; — 

o o \ 2N  co  1 

' o o 


Using  co  T = mr  in  Equation  (2-110),  f reduces  to 


■> 

A“T 


(2-1 1(1) 


2N 


f = e 
o 


(2-117) 


2-29 


_____ 


From  Equation  (2-94),  f (t  ^ , t is  given  by 


f.,(t  , t.,)  = E cos (co  tj  + m)  cos ( co  t + 


^2„,  sin  co  T 

exp  - 77^—  1 *-  rp — cos  (2 m t-  u>  T) 


P’or  co  T >>  1 or  co  T = hit,  n 4 0 f,.(t,,  t ,)  becomes 
o o ’ 2 1 ’ 2 


f.,(i|»  1 1>>  = K|cos(co^tj  + m)  cos(io  t.}  + m)l  e 


(2-122) 


(2-123) 


Expanding  the  sinusoids  in  Equation  (2-123)  and  taking  the  expectation  there 


results 


f2(tl’  V = I ,COS  Woll  cos  Wot2  f 8ln  “o1!  8in  -o*2’ 


e . (2-124) 

Using  Equations  (2-117),  (2-121)  and  (2—1 24)  in  (2-93),  an  approximation  to  the 
likelihood  ratio,  using  only  the  first  three  terms,  can  be  w ritten  as 


A.,lr(t)l  = e ° 1 + jflr)  (I“  + Q“) 


(2-125) 


where  1 and  Q are  defined  in  Equations  (2-99)  and  (2-100),  respectively  and  the 

•>A 

subscript  refers  to  the  exponent  of 

o 


Note  that  both  Equations  (2-125)  and  (2-114)  are  monotonic  functions  of 
1 

•>  .)  J 

0“  + Q“>  . It  follows  that  for  u»oT  = mr,  n * 0,  the  performance  of  a receiver 
based  upon  A|r(t)]  and  A2lr(t)J  are  Identical  even  though  Alr(t))  and  A.,|r(t)l  are 

i 

very  different  functions  of  (I2  + Q2)\  Including  the  first  five  terms  of  the 
likelihood  ratio,  it  can  be  shown  that 


A4lr(t)l 


A“T 


■>  •> 


+ 


64 


(2-12(1) 


where  the  subscript  refers  to  the  highest  exponent  of  M . Kquation  (2-126)  is 

; ° 

also  a monotonic  function  of  (I2  + qV.  Note  that  expanding  y.)  in  Equation 
(2-114)  in  a Taylor  series  results  in 


A [r(t)l 


•> 


(2-127) 

Hence,  A2N(r(t)]  is  obtained  by  truncating  the  expansion  of  A (r(t)J  after  2N  + 1 
terms.  Since  all  the  coefficients  in  the  expansion  of  y •)  are  positive  and  since 

I 

(l“  * Q~)  is  positive  it  follows  that  both  A2Nlr(t)l  and  A (r(t)l  are  monotonic 
1 

functions  of  (I“  + Q~)  . Generalizing,  it  follows  that  receivers  based  upon 
A (t  (tt!  and  V,Nlr(t)|  have  identical  performance  for  uyr  = nrr.  It  follows  that 


2-62 


it  is  not  always  necessary  to  take  many  terms  in  the  Volterra  functional  expan- 
sion of  A |r(t)l  in  order  to  obtain  acceptable  performance.  Of  course,  for  this 
example,  A0„[r(t)]  N = 1,  2,  ...  all  turned  out  to  be  monotonic  functions  of  the 

i 

2 2 ^ 

same  statistic  (1“  t-  Q“)  . For  most  nonlinear  problems  the  sufficient  statistic 
for  AON(r(t)]  will  not  be  the  same  as  the  sufficient  statistic  for  A fr(t >1 . This  is 
apparent  from  Sections  2.3.  1 and  2.  3.  2 where  the  formulation  of  a simple  suffi- 
cient statistic  appears  unlikely  due  to  the  form  of  the  Volterra  kernels  (i.  e. , 
higher  order  kernels  cannot  be  expressed  as  combinations  of  lower  order 
kernels).  Then,  the  closer  A.,N(r(t)l  approximates  A(r(t)l,  the  closer  the 
receiver  performance  approaches  the  optimum.  In  general,  it  is  not  clear 
how  large  N must  lie  to  obtain  acceptable  performance. 

3.  4 Sun's  Theorem  and  Asymptotic  Receivers 

In  this  section,  it  is  shown  that  for  the  class  of  nonlinearities,  S|t,  m(t)], 
and  Gaussian  processes,  m(t),  satisfying  Sun's  Theorem*  1 24)  the  higher  order 
Volterra  kernels  are  representable  in  terms  of  lower  order  kernels  as  the  length 
of  the  observation  interval  goes  to  infinity  (T  — 00 ).  For  this  case,  asymptotic 
sufficient  statistics  can  be  obtained  for  which  performance  can  be  determined. 

2.  4.  1 Asymptotic  Receiver  Derivation 

From  par.  2.  1,  the  likelihood  ratio  for  the  detection  problem  of  Equations 
(2-1)  and  (2-2)  is 

~ ( T T 

A[r(t)l  = Titir)  f ‘ f r(tl)“ * P<V  fi<*i tt)  dtt dtt 

i=o  ' ° o o 

(2-128) 


'Sun's  Theorem  is  discussed  in  Appendix  A. 


who  re 


/ 


f,(tr  ...  tj)  = K 


\ 


Sltj,  m(tj)l  . . . Sltj,  m(tj)J 


exp 


2 

- [ 8-It.  m(T)l  dr 

o J 


(2-129) 


In  this  section,  asymptotically  optimal  receivers  are  obtained  for  the  special 


case 


^i  d j » •••>  t jl  K t \ S [t  j , m(tj)l...  b[tj,  m(t  j)l } 

where  K is  some  proportionality  constant  independent  of  1.  ♦ 

At  this  point  It  is  convenient  to  define 

djdj tj)  = EfSltj,  m (t ^ ) 1 . . . S(tj,  mftj))}  . 

From  Equations  (2-130)  and  (2-131) 

lj(t|,  ...,  tj)  - K dj(t  j,  ....  tj) 

Suppose  that  d^ t^,  where  0 st  s T for  j = 1 i,  is 

expanded  in  a multidimensional  Fourier  series.  For  1=1,  2,  and  3 the 
expansions  are 


(2-130) 


(2-131) 


(2-132) 


w = X) 


*1  = ° 


.11  2ffll 

d.  cos  — r= — 

1 1 


12  2jril 

'l+\  Sln  — *1 


(2-133) 


‘For  many  an^le  modulated  sinusoids,  Equation  (2-130)  applies.  An  angle 
modulation  example  Is  treated  in  Section  2. 1.2. 


rho  Fourier  coefficients  are  determined  in  the  usual  manner.  The  first 


few  are 


d;;  t / <w c 


cos  — — — t j dt  j 


a 


d,(t.l  . - " 1 1 1 , ,. 

1 1 sin  — — — 1 1 dt  j 


d.  21 

‘l  ‘2 


'2  \2  7 J Zirij  2 :ri 

t)  J J d2(tr  *2'  008  “f"  ‘l  COS  "T"  l2  d,l  dt2  • 


At  this  point  it  is  convenient  to  define 


*,  rf 


r(t)  cos  t dt 


(2-136) 


t 

2 A f ...  . 2 iri  . 

N~  I r<n  Sin  — * 

o J 


dt  . 


(2-1371 


I’nder  H . x,  and  v,,  i 0.  I are  lointlv  Gaussian  and  statistically 

o i i 

independent  with 


E(x.  | H 1 Efv.lH  1 0 

M o i o 


(2-1381 


o 

1 2A  T 

K(X.  X,  II  1 o -rr-1- 
M 1 o 2 N i| 
o 


F(v.  v.  h i ^ 

'•  i ■ | o 2 ij 


(2-1391 


K(x.  v.  Ill  1 0 

M i o 
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Under  Hj,  x.  and  y i 0,  1 ....  may  be  asymptotically  jointly  Gaussian.  (In 
Appendix  A,  this  is  shown  for  the  case  S (t , m (t i i cos  (o>  t * m(t u . The  proof 
makes  use  of  Sun's  Theorem*  and  the  Cramer -Wohl  Theorem. ) The  expected 
value  of  v conditioned  on  1 1 ^ is 


r T 

t(x.  M jl  jjp-'  J A E i S ( 1 1 m(tl]  1 cos  t dt  < j E|n(tll  cos  t dt  j 
o o 


From  Equations  (2 - 1 ;t;tf  and  (2-1311  it  follows  that 


E(x. IH 


Similarly 


L'(v.  IH1) 


o 

2 AT 


N 

o 


In  like  manner 


E(\.  x I H \ 

i J 1 

^ V’v 

E(v(  x 


(2-1401 


(2-1411 


(2-1421 


(2-1431 


(2-1441 


E(.v,  v 1 11,1 


t 

4 


1 1 2 A 

o 


N 


6,, 


(2-1451 


*Sun's  theorem  requires  that  m(tl  be  a zero  mean  stationary  (laussian 
process,  cither  restrictions  on  m(tl  and  s[t,  m(t)l  are  discussed  in  Appendix  A. 

An  example  which  satisfies  Sun's  theorem  is  presented  in  Section  2.  4.3. 
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Utilizing  the  asymptotic  statistics  of  Equations  (2-136)  and  (2-137)  it  is  possible 
to  obtain  the  Fourier  coefficients  of  Equation  (2-135)  in  terms  of  the  Fourier 
coefficients  in  Equation  (2-133)  and  (2-134).  To  see  this,  recall  that  if 
z 7 ami  z..  are  Jointly  Gaussian,  it  follows  that  [25,  p.  7 1 1 

l | K 

E(z.  z,  z..)  ( E(z.  z.)  - E(z.  ) K(z.  ) 1 E(z,) 

I | K l 1 \ 1 

♦ I E(z.  /j.)  - E(z.)  E(z.j_) | E(z  ) 

-*•  I E(z.  zk>  - E(z  ) E(z.j_)|  E(z.) 

+ E(z.)  E(z  ) Ejz^) 


Consider 


T T T 


e<VjVhi'  (I1)'  Jff  [v’Vr  VV 


o o o 


N 

A -j-  d^tj)  d(t2  - t3) 


A"r  «W  fi«i  -V 


N 

‘ A d1(t3)  6(tj  - t2) 


(2-146) 


2 ir  i . 2 rr  1 . 2jrk 

cos  -7T—  t,  cos  -^r1-  tn  cos  — — t.,  dt , dt0  dt.,  . 


T 1 


T 2 


T ‘3123 


(2-147) 


From  Equations  (2-147),  (2-135)  and  (2-133) 


1 / 2A  r \ ,31  1 / 2A  T \/j 

E'V)V"i’  *\— ) V*4\— J(di 

■)  ■ 


Jk 


,11  . , .11  , 
d,  6 * d.  o 
J ik  k ij 


(2-148) 
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On  the  other  hand,  substituting  Equations  (2-1-10)  and  (2-1-12)  into  (2-I-ltii 


•W)  

Compa ring  Equations  ( 2 - 1 4 S ) with  (2-140).  it  follows  that 
dS1  h21  ,in  421  i11  421  J1  0.11  ,11  .11 

l,.1k  dii  dk  'd,k  dJ  dlk  di  ~2di  dJ  dk  • (2-150) 

In  a manner  similar  to  that  used  in  the  development  of  Equation  (2-1-ISt, 

w WfK  •*(*£)  v.“ 


(2-151) 


Substituting  Equation  (2-140)  to  (2-145)  into  (2-140)  results  in 

evp'v 


I /2A_T\  12 

4 \ No  / > ‘ 

Comparing  Equations  (2-151)  with  (2-152).  observe  that 

,32  .22  11  92  11  ?i  1?  tr>  ii  ii 

‘ ilk  dlJ  dk  "dikdj  ‘ djk  di  -2di  d|  dk 

Similarly,  it  is  readily  shown  that 


(2-152) 


(2-155) 

(2-154) 

(2-155) 


d' 


35 

[ . 

d24 

.11  ,22 
d + li  . 

d12 

ilk 

ij 

k 

ik 

} 

,36 

99 

dfT 

,12  , ,24 

d11 

ijk 

ij 

k 

lk 

J 

37 

= d23 

,12  .23 

d,  + d,, 

d12 

ijk 

u 

k ik 

) 

38 

= ci24 

,12  .24 

d if 

d!2 

ijk 

ij 

k 

ik 

j 

,12  ,12  .11 
i.  d,  d. 
i j k 


,12  0 ,12  .11  ,12 

d.  - 2d.  d.  d, 

i l ] k 


'i  "j 


(2-156) 

(2-157) 

(2-158) 

(2-159) 


With  reference  to  liquations  (2-133)  and  (2-134),  now  consider 

dj(tj)  d.,(t.,,  t^)  + dj(t,7)  d,,(t^,  tg)  + dj(tg)  ^2^1'  ^2^ 


ZEZ(<r  <■  -r  -s $ ) - 

i j k 


2 7T  1 , 2 7T  i . 

-y  t cos  -y  t9  cos 


2 7T  k , 
T *3 


l .12  ,21  ,11, 22  ,11  ,22  \ , , * n i ^ ~ , 

+ (dj  d.j.  + d.  dlk  + d^  d..  ) sin  — y t1  cos  -y  t9  cos  -ts—  t 


.11  ,22  ,12  ,21  11  ,23  \ 

di  djk  + dj  dik  “ dk  dij  1 COS 


2 it  i 


2 7T 


T 1 


2 7T  i 


2tt  k 
T "3 


2 7T 


2ir  k 


y-  tj  sin  yH-  t9  cos  ~Tp — tg 


,11  ,23  , ,11  .23  ,12  .21 

d.  d.,  + d.  d..  + d,  d. . 
i lk  j tk  k ij 


2 it  i . 2ffi  . . 2 tr  k . 

cos  — y cos  -y  t sin  — — t^ 


I,  U., 

i jk 


,12 

,n 

sin 

2 7T  i 

*1 

9 j 

l2 

2 rr  k 

l3 

+ dj 

d““ 

lk 

+ dk 

V 

T 

sin 

T 

cos 

T 

,11 

,24 

,12 

sin 

2 7T  i 

ll 

2 ir  j 

l2 

2 TT  k 

+•  d. 
j 

d 

lk 

"dk 

\) 

T 

COS 

T 

sin 

T 

*3 

+ d12 
j 

"i3 

^dJ2 

cos 

2 it  i 
T 

ll 

sin 

- 7r  j 
T 

*2 

sin 

2trk 

T 

<3 

,d12 

J 

£ 

,12 
+ dk 

0 

sin 

2 7T  i 

T 

sin 

f1 

t2 

sin 

2 TT  k 
T 

*3 

(2-160) 


40 


di<V‘W  W 


\ ' \ 1 \ ' ,11,11,11  11  7T  i , — 71  l , . . - (I  . 

2^2^  Z-»lli  dj  l,k  COS  ~ 'l  t>os  — 2 108  ~ T ’ll 


t J k 


1 1 “ 

d" 

.1 

,n 

dk 

sin 

2 77  i 

c*os 

2 7T  i 

4 

COS 

2 77  k 

Cl. 

1 

T 

*1 

T 

>0 

T 

d11 

1 

d12 

.1 

cos 

2 ?r  i 

>1 

sin 

'll! 

cos 

2 77  k 

T 

T 

*2 

T 

d11 

.1 

C’OS 

2 n i 

4 

cos 

2jrj 

4 

sin 

2 7T  k 

t 

‘l 

T 

l2 

T 

•I,12 

d12 

.1 

i' 

sin 

2 7 r i 

sin 

2tt  j 

4 

cos 

2 77  k 

T 

*1 

T 

l2 

T 

d12 

1 

d11 

.1 

sin 

2 7 7 i 

4 

cos 

2tq 

4 

sin 

2 7T  k 

T 

I 

1 

T 

f2 

T 

dn 

i 

,112 

d12 

(*OS 

2 n i 

4 

sin 

2 7 r j 

4 

sin 

2 77  k 

(1  . 

J 

dk 

T 

1 

T 

T 

12 

dj 

d12 

.1 

-Is 

sin 

2 77  i 

« 

sin 

2 7C  j 

*2 

sin 

2 77  k 

T 

1 

T 

i' 

(2-1(511 


Substituting  Kquations  (2-150)  and  (2-153)  through  (2-159)  into  Kquation  (2-135) 
and  making  use  of  liquations  (2-1(50)  and  (2-1(51)  it  follows  that 

Vr  ‘2’  V * lVVd2(t2'  '3'  Hdi(Vd2(,r  V +,Wd2(tr  ’2' 

(2-1(52) 


2d1(t  ])  djdjj)  d]  (t  ;l> 


where  — denotes  "is  asymptotically  equivalent  to". 


Note  that  Fquatlon  (2-l(>2)  nm  l>e  written  In  the  form 


t.,,  tg)-  (d.,(t.,,  t3>  - dx(t2)  d^tg)]  d1<t1) 

» ld.,(tr  t3)  - d1  (t1>  dt(t3)l  d^t.,) 

+ ld2(tr  t.,)  - d1(t1>  d1(t2)l  dT(t3> 

f dj(tj)  dj(t2l  djffjl  . (2-163) 


Also,  note  that  the  asymptotic  form  of  d.?(tj,  t„,  t.{)  Is  symmetric  In  Us  argu- 
ments, Following  the  same  procedure  that  led  to  Kquatlon  (2-1(52)  It  can  be 
shown  that 


d4 (t , , t2,  t3,  t{)  - d2(tr  t2)d2(t3,  t4)  * d2(tr  t3)d2(t2,  t4) 

+ d2(tr  t4)  d2(t2,  t3)  -2d1(t1)  d4(t2)  d1(t3)d](t4)  . 


(2-164) 


l'.quatlon  (2-164)  can  lx-  rewritten  In  the  form 

d jdj,  t2,  t3,  t4)  * ld2(tj,  t2)  - dj(tj)  dj (t 2>]  ld2(t3,  t {)  - d4(t3)  d1(t4)l 


► l',2(tl*  S'  “ di(,l'  dl(S"  ld2(t2’  S'  ' dl(t2>  di(S" 

Md.,(tr  t4)  - dj(tj)  d4(t4)]  ld2(t2,  t3l  - dj (t2)  d^tg)] 
*-  ld2(tr  t.,)  - djtfj)  d1(t2)l  d1(t3)  d4(t4) 

► ld2(t tg)  - d 4 (t  4 ) dj(t3)]  d4(t2)  d1(t4) 

*■  ld,,(t  j,  t ()  - d1(t1)  d](t4)|  dj(t2)  dt(t3) 

f |d2(t2*  S'  "‘VS'  dl(S"  Ml' d l (t  4 ' 

*•  M2(t2,  t4)  - dt(t2)  dt (t4>l  d1(tJ)  d4(i3) 
ld2(t3.  t4)  - d1(t3>  d1(t4>l  d4(t4)  d^tj 
*■  d 1 (t J > dj^g)  d1  (t3)  d1  (t4)  . (2-165) 


At  this  point  It  Is  convenient  to  let 


1 

nj  = J.l.J  ....  tt)  r(tj)  ...  r(ti)dt1...  dtj 


nl  = '?  = J dl(tj)  r(tj)  dtj 


(2-16(5) 


(2-167) 


T T 


= / / fd2(tl*  l2}  “ dl(tl)  dl(t2)1  r(tl)  r(t2)  dtl  dto  - (2-168) 


Utilizing  Equation  (2-166),  it  follows  that 


n.j  — 3 n v + >1 


Similarly,  making  use  of  Equation  (2-165),  there  results 


n — 3 1’"+  6 r + n • 


(2-169) 


(2-170) 


Substituting  Equation  (2-16(5)  into  Equation  (2-128)  and  making  use  of  Equation 
(2-132)  the  likelihood  ratio  may  be  expressed  as 


\ iv (t ) i — k J2  it  fir-)'  ",  . 


(2-171) 


However,  for  some  cases  n(  can  be  interpreted  as  the  Ith  moment  of  a Gausslaj 
random  variable  z with  mean  V and  variance  r.  The  characteristic  function  of 
z is  given  by  - 


E[exp(coz)]  = exp^  w2(-  + ^ i)^j 

vX) 

V"  i i 

p w n,  • 


(2-172) 


Comparing  Equations  (2-171)  and  (2-172),  It  follows  that 

* 


A (r(t)l  - K oxp 


1_  /2A 

2 In 

\ o 


1'  f 


N 


V 


o , 


•Justification  for  flu*  generalization  to  n(  at  this  point,  I hough  convincing 
tn  the  light  of  Kqnatlons  U-l«9>  anil  ('J-1701,  has  not  been  given,  liquation 
1..-1  ..ll  can  he  proven  hv  another  method  which  relies  .Ml  an  observation  line  to 
V Nuttall  suggested  to  this  author  In  a private  communication,  from 
filiations  <2-1281  and  (2-1301  It  follows  that 


\lr(tl|  K f exp 


( ‘ 
M 


r(n  sit,  m ft ) | (It 


/•>\\  " 

Nuttiill  roi'0|{nl/.tHl  that  Alr(t)|  * K where  4*  <u>)  Is  the  moment 

' 1 o'  I 

generating  function  of 

r 

/ J r(fl  S|t,  m((tl  dt 

o 

with  rfti  fixed.  Note  that  / has  mean  V and  variance  i . If  / Is  asymptotically 
(•ausslan,  then  Equation  01-1731  follows.  To  see  \f  7\s  asymptotically  ('Russian 
expand  r<n  in  a Fourier  series  to  obtain 


t sit,  mfttl  ill 


7 “ H ri"  J i'°s  H 

1 ■ o o 

T 

f rl  ~ J -sin  t S(t , m(t\|  dt 


whore 


i 

^ J rfti  cos 


t dt 


i 

•jr  J r ft  > sin  t dt 


In  general,  / is  not  asymptotically  uanssutn.  However,  in  Appendix  \ 
It  IS  Shown  that  for  the  s|xvinl  ease  sit,  i - eos  ,.e  t . i 

o 

r 

I »*OH  t S|t,  111  (til  dt 


ami 


t s|r . m(Ul  dt 


an-  asymptotically  tolntlv  l.auaslan  for  1 o N,  N arldtrarllv  large 

Henee.  for  this  ease,  / ,s  asymptotically  tlanssum  and  so  ,2-I73i  applies 


ft, 


Substituting  Equations  (2-167)  :ui<i  (2-168)  into  (2-173)  the  logarithm  of  the 
likelihood  ratio  is  asymptotically  represented  as 


inA[r(t)l  = i f r (t  > ) — 


o T T 


■J  \Wj  J j f d2(V  ’2’  " lll(,i'  ‘V’  *'1  r«1'  r(t„)  dt]  dt„ 


/ 11 1 


r(1j)  «lt]  + In  K 


(2-171) 


Recall  from  Equation  (2-131)  that 


‘W  *2'  KfS|tj,m(tj)|  sit.,,  m(t„)|  ) 

Kfs|tr  ni(t  ^ )|  ) . 


(2-173) 


(2-176) 


Equation  (2-174)  yields  the  asymptotic  receiver.  However,  conditions 
have  not  been  found  under  which  T is  large  enough  for  (2-174)  to  apply 
2.  1.2  Asymptotic  Receiver  Performance 

Rrom  Equation  (2-174),  a receiver  based  on  the  logarithm  of  the 
likelihood  ratio  for  long  observation  times  is 


*-lr<n)  nK  = \('~ 


O T T 


I d 2 (*  1 • ’2'  " dldi'  did->'l  r(tj)  r(t„) 


(jr)  J d 1 d 1 ' r d ' d(  1 


(2-177) 


2-4  3 


where 

d.  (tj t.)  = E {Sftj.mtfj)]  ...  S^m^l]  | . (2-178) 

Recall  that  r(t)  = AS  [ t,m(t)]  + n(t)  under  hypothesis  H^.  In  this  section, 
it  is  shown  that  the  conditional  moments  of  l ' [ r(t)]  given  H.  and  the  con- 

oo  A 

ditional  moments  of  f ’ [ r(t>]  where  r(t)  = AS(t)  + n(t)  are  asymptotically 

00 

equal  provided  that  S(t)  is  a Gaussian  processes  with  the  same  mean  and 
autocovariance  as  S [t,  m(t)]  and  provided  that  m(t)  and  S(t,  , ) satisfy  Sun’s 
theorem.  It  then  follows  that  the  asymptotic  performance  of  the  asymptotic 
receiver  may  be  found  by  considering  the  Gaussian  process  S(t).  Conditions 
on  the  length  of  the  observation  interval,  T,  under  which  the  asymptotic 
performance  of  the  asymptotic  receiver  closely  approximate  the  performance 
of  the  optimum  receiver,  have  not  been  obtained. 

Consider  the  random  variable 


x 

Z1  = J r(t)  S[  t,  m(t)] 


(2-179) 


with  moments 


“1 

E(Zl)  = T1l,i  =/  f r(t1)...r(t.)E  |S[  tj.mtfj)]  ...S[  t.,m(t.] 


dt, . . . dt. 

1 l 

and  the  Gaussian  random  variable 


(2-180) 


r(t)  S(t)  dt 


(2-181) 


2-46 


with  moments 


"1'i  T 


E(Z2)  =t,2,  i = f -f  r(t1)...r(t.)E[S(t1)...S(ti>]  dtj...dt..  (2-182) 


If  m(t)  and  S(t,  . ) satisfy  Sun's  theorem  and  if  »;  0 = >;  and  rj  0 = tj 

-»  1 -1 2 1, 

then  it  follows  from  par.  2.4.  1 (see  footnote  pg.  49)  for  T-*lV  that 


"l.i  * 2.  i 


(2- 1 S3) 


for  i ^ 2. 


Substituting  Equations  (2-180)  and  (2-182)  into  (2-183)  there  results 

E {Sft1,m(t1)]...s[  t-.mftj)]}  * E[S(t1)...S(t.)]  . , 


(2-184) 


Now  consider  the  moments  of  t ' f r (t)]  under  11  From  Equation  (2-177) 

CO  1 


it  follows  that 


E ({f  ’ [ r(t)]  ( K l I!,  ) 


r<t1)r(t2)[  d2(t1.  t2)-di<t1)d1(t2>]  dtjdt2 


r(t)dj(t)dt 


(2- 1 sr>) 


J 


Expanding  the  argument  of  the  expectation  in  Equation  (2-185)  there  results 


v T T 

K r r 


E{['jr(t”]  K|"l)  (fr)  / * / K[r(tl...r(tKmi1) 


o o 


djttj).  . - dl  dtl*  • dtk 


-t  ^ 


T T 


o o 


fd2(trt2Nl(,l|dlM  ---f  d2(t2i-l’t2i)'dl(t2i-lldl(t2i'1 

dl(t2lfl>*  • -dl(tK^i'  dtr  "dtKtl  * 

Focusing  attention  on  the  expectation  in  Equation  (2-180),  note  that 


(2-180) 


E[  r(tj).  - • r(tK  . ) I Hj  ] 

= E ( J AS  [tj,  m(tj)]  +n(t1)|...  { AS  [tK+.,  m(tR+i)]  + nft^)  | ( Hj  ) . 


(2-187) 

Consider  first  the  case  for  which  K<i  is  an  even  integer.  Multiplying  out  the 
right-hand  side  of  Equation  (2-187)  and  simplifying  those  terms  involving  n(t) 
as  a factor,  it  follows  that 
E[  r(tj). . • r(tR  .)  ! 

= AKm  E j Sf  tj,  m(tj)]  ...S[  tK  .,  ! 

* AKl"2  -f  E[  "Oi,'1"'!;,'! 

) 

K 7 T sf  *j.  m(tj)]  > jVij,  i2 


. (i) 

\ 2 / 


N \ K ‘i 


E[  nttj).  . .n(tKfj)] 


(2-188) 


2-48 


where  the  first  sum  is  over  all  wa-vs  of  choosing  two  arguments 

from  K+4.  Evaluation  of  the  expectations  involving  the  noise  term,  although 
known,  are  not  required  for  the  argument  to  follow.  Similarly,  for  (i+K)  odd 
K[  r(t1)...r(t.+K)!H1] 


AK+i  E 

1 S[  tj,  mftj)]  . 

••S[  Wm(W]1 

aEm-2 

No  w 

T Kf  n<ti1>nCti2>] 

/ i +K 

i 

E 77" 

s[  t.,  m(t.)]  | 

j^rl2 

j=i 

\T  \ rv  T i-  1 

A(~r)  " E { S[  t^.mlt.j)] 

E[  n(t1)...n(tii_im(tii+1)...n(tK+.i]  | (2-189) 


Substituting  Equation  (2-184) 


into  both  Equation  (2-188)  and  (2-189)  results  in 


E[  r(t1)...r(tK4.)!H1].E[  r (t  2 > . . . r(tR+i ) | r (t)  = AS(t)  <n(t)l  (2-190) 

l sc  of  (2-190)  in  (2-180)  leads  to  the  conclusion  that 

K(|^’  f r(t)l(  Kmi)  • E ( ; f ' [ r(t)]  f K | r (t)  = AS(t)+  n(t) ) (2-191) 

Since  the  probability  density  function  of  ( [ r(t)]  given  H,  is  determined  bv 

^ 1 *T 

the  moments  of  t f r(t)]  given  H.,  it  follows  that 

iV  1 


1’-  ' 


, ' |Hi  (X'Hjt-iy  |r(t)=AS(t)+n(t)  f X|r(t)=AS(t)m(t)] 


(2-192) 


and  that  the  detection  probability 

00 

PD  = / P#?  |H  (X  IHj)  dX  (2-193) 

y 00  1 

may  be  evaluated  by  considering 

CO 

PD~  / P,  ' |r(tJ=AS(t)+„(t)  [ X|r<l)-AS(t)«(t)]  dX  (2-194) 

y 

for  T-»M  . Therefore,  the  asymptotic  receiver  operating  characteristic  (R.O.C) 
of  the  asymptotic  receiver  is  evaluated  considering  an  equivalent  problem 
where,  under  H^,  r(t)  = AS(t)+n(t),  S(t)  is  a C.uassian  process  with 

E[  S(t)]  = E { S[  t,m(t)]  | , (2-195) 

and 

E[  SCfc1>S(t2)]  = E |S[  tr  m^)]  Sf  t2,  m(t2)]  | . (2-196) 

When  Equation  (2-177)  is  the  low  energy  coherence  (L.  E.  C. ) receiver  (see 
Appendix  C)  for  S<t) , the  asymptotic  performance  is  easily  obtained  using  the 
Chernoff  approximation  of  Appendix  C. 

Assuming  that  T is  large  enough  so  that  the  asymptotic  receiver  is  a 
good  approximation  to  the  optimum  Neyman-Pearson  receiver,  performance  of 
the  optimum  receiver  will  be  closely  approximated  by  the  asymptotic  performance 
of  the  asymptotic  receiver.  It  has  not  been  possible  to  obtain  general  conditions 
which  assure  that  T is  sufficiently  large. 


I 


-50 


- • £ . . ■ 1 ll**" 


2.4.:!  An  Example  - First  Order  Butterworth  Phase  Modulation  of  a Sinusoid 


For  this  example,  let  the  hypotheses  be  given  by 
H^:  r(t)  = A cos  [(o^t  + m(t)]  + n(t),  0 s t - T 

H : r(t)  = n(t)  0 - t - T 

when.'  m(t)  and  n(t)  are  statistically  independent  Gaussian  random  p 
the  properties 

E[m(t)]  = K [ n (t  > ] = 0 

E[m(tj)m(t9)]  = Pe~“  tj-t2 

N 

E[n(t1m(t0>]  = (5  (t  j -t0>  . 

From  the  correlation  function  assumed  in  Equation  (2-200),  the  spe 
m(t)  is 

2oP 

hnito)  - — o • 

a * cn~ 

From  par.  2.  1,  the  likelihood  ratio  is 

i T T 

A [ r (t ) ] -y;  tt  r(t1)...r(t.)f.(t  t ) dtj...  d 

i=0  ' ° o o 

where 

fjt*! t.)  = E ^cos  Uptj+md^] ...  cos [a>0t . *m(t.)] 

exp  { " J cos~  U0tHnft']  dt  } ] • 

° o ' 


(2-197) 


(2-198) 


andom  processes  with 


(2-199) 


(2-200) 


(2-201) 


spectrum  of 


(2-202) 


dt . (2-203) 

i 


(2-204) 


f 


Expanding  the  exponential  in  Equation  (2-204),  f (t^,  . . .,t.)  becomes 

E |cos[cD0t1*m(t1)]...costo0t^m(t.)] 

e°s2  U0tiU+m(ti+1)]-COs2  [“oti+]"m(tl+j']  } 

dt.  , ...dt.  . , (2-205) 

l + l l +j 

o . 

Recalling  that  cos“0=  | (1  + cos  20)  it  follows  that 

i O 

E | cos  [cD^j+nUtj)]  . . .costcu^jHiMt.)]  eos~  [a^t. +1 +m(t.+1)]  ... 

cos“[fD  t.  . +m (t . ,)1  > 
o l+j  i+j  1 

= -j  E | cosfcD^j+mftj)]  . . .cosfa,ot.+m(t.)}  | 

+ Terms  involving  2 qj  t ; K = l + l,  ...  . (2-206) 

Hence,  the  integrand  in  Equation  (2-205)  involves  a constant  with  respect  to  the 
variables  of  integration  plus  rapidly  oscillating  terms  which  contribute  negligibly 

to  the  integration.  Consequently,  Equation  (2-205)  can  be  written  as 

A-T 
" 2N 

fj(t1 t.)  > e ° E | costoj^j  +m(t j)] ...  cos[(0ot.  +m(t.) ] | . (2-207) 

-A“T  °N 

Comparison  of  Equation  (2-207)  with  Equation  (2-130)  shows  that  K = e °. 

In  Appendix  A it  is  shown  that  x.  and  v.  defined  bv  Equations  ^2-136)  and  (2-137) 


art-  asymptotically  Gaussian  when  S(t,  m (t ) > * cos  (cD0t+m(tt).  Hence  from 
Equation  (--177) 


T T 


= \ (jr  ) / / [d2(tl’t2)~dl(tl)dl<t2)1  r(ti>r(t2>  dti  dt2 


T 


Tr)  / d1(t1>r(t1>  dtj 


(2-208) 


where,  from  Appendix  R, 

‘VVV  - E {cos^^^mftj)]  cos [o>0t2+m(t0)]  } 


-1' 


l 1)  |t  1 "*to  I. 

cosh  (Re  1 - ) cos  cos,„ot„ 


*■  sinh  (l’e  ° 1 1 -t - \ sin  (0  t,  s 


£Vl  sin  03 o*: 


] 


(2-209) 


and 


d1(tJ)=  E ] cos  [as^j  mdj)]  } = e~V  2 cos  . (2-210) 

In  Appendix  C par.  C.  2 it  is  shown  that  Equation  (2-208)  can  be  interpreted  as 
the  LEC  receiver  for  a Gaussian  process  with  mean  and  autocorrelation  given  by 
Equations  (2-210)  and  (2-209)  respectively.  In  Appendix  11  par.  D-2  it  is  shown 
that  the  LEC  condition  applies  for  this  process  over  a wide  range  of  values  for 
P and  oT.  As  discussed  in  par.  2.  4. 2,  the  asymptotic  performance  of  the 
asymptotic  receiver  is  evaluated  by  considering  an  equivalent  problem  where, 
under  Hj,  r(t)  = AS  (t)  *n(t)  where  S(t)  is  a Gaussian  process  with  mean  and  auto- 
covariance given  by  Equations  (2-210)  and  (2-209)  respectively.  As  pointed  out 


in  Appendix  C (see  C- 23),  the  LEC  receiver  for  the  equivalent  problem  is 
determined  from  Equation  (2-208).  Using  only  values  of  P and  «T  such  that 
the  LEC  condition  applies,  performance  is  obtained  by  employing  the  Chernoff 
approximation  discussed  in  Appendix  C.  From  Appendix  C 

PFA  e'“S>-S*‘<SI  [ /A*  2*erfc.  (SvUisT,  (l  - &is!  ) 


6[u(S)]  ~sf2v 


(2-211) 
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0 \r2 ~(p(S))3  2 \ 


(2-212) 


where  S is  chosen  so  that  p(S)  = y , 0<S-  1,  and  is  the  threshold.  Also, 


from  Appendix  C 


S|1-SI  ( I A-  ^ -21'  i 1 OT  11-e'2 

2 \\NV>/  ‘ | 2 f-  2«  1 2i” 


.V  O j 


-2iaT 


- (2-S)  V — — - 

Z_^  2i'.  i „.2 


-2ioT 


A“  \ -P  ... 
— c 

i o / 


(2-213) 


Note  that 


tfrr)  « 


an  In'  interpreted  as  a signal-to-noise  ratio  (SNU).  Also, 


\rF  ran  lir  interpreted  as  (hr  modulation  indrx.  Figures  2-1  thru  2-11  show  thu 

rrrrivri' opr  rating  rha  rartr  rist  irs  (IUK'1  for  a wldr  range  of  SNU,  \rV  ami  nT. 

Nolo  that  doe rousing  SNH  by  10  dll,  say  from  -10  dll  to  -20  dll,  and  inereasing 

o l'  by  a fartor  of  100,  say  from  IO->  to  10  ' results  in  idrntiral  U(UMs  at  the 

higher  SNH's.  At  lower  SNH's,  doeroasing  SNU  by  10  dll,  say  from  -SO  to  -;H)  dll, 

IS  10 

and  inereasing  o T by  a tartor  of  10,  say  trom  10  to  10  , also  results  in  lUVs 

whirh  are  rlose.  This  suggests  a threshold  effort  in  rerrivi'r  porformanee . 

No 

Also,  note  that  inereasing  T loro,  A,  -77-  , 1’,  and  I'  given,  results  in  a 
monotone  deereasing  miss  probability,  l’  In  addition,  inereasing  1’  with  A, 


o 

— — . o . 


and  I’  given,  results  in  an  inereasing  1’^. 


1.  Miss  Probabililv  (1’^  1 I ' vs  lalso  Alarm  Probability  l'|^' 
Paraiuotrli'  in  1 imo  bandwidth  Product  (,\  T)  tor  a Signal  to  Nolso 

Hallo  (NNK  ' 1 ol  10  dll  Modulation  Index  \y  PI  of  1.2s  ■>. 
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2-10.  1’  vs  1’ 


Parametric  in  lXT  for  SNK  -SOiiP  and  \1'  1 . a 


1.'  A 


12 . 4 . 4 Suboptimum  Detection  of  a First  Ol  der  Hutterworth  Phase  Modulated 


Sinusoid 

In  the  hypothesis  testing  problem  of  par.  2.4.3,  the  hypotheses  are 
Hj!  r(t > A cos  ( -M  * tn(t)]  * n(t)  , 0^_  t ^ T (2-214) 

ID:  r(t)  n(t)  , 0^  t ^ T (2-215) 

where  m(t)  and  n(t)  are  zero  mean  independent  Gaussian  processes  with  auto- 
correlation functions 

-a  (t.  - t.,1 

Elnutjl  m(t2>]  Hm(ti,  t„)  Pc  “ (2-21t?) 

N 

E | n(t  j ) n<t^>  | c'Mtj  - t„)  . (2-217) 

Consider  the  detector  sketched  in  Figure  2-12  which  is  optimum  for  detection  of 
a sinusoid  having  a constant  random  phase  angle  uniformly  distributed  on  [ 0,  2t  | . 
In  this  section,  the  performance  of  this  detector  is  determined  for  the  hypotheses 
of  Equations  (2-214)  and  (2-215).  As  exacted,  the  optimum  detector  is  shown 
to  outperform  the  detector  of  Figure  2-12.  However,  for  signal  to  noise  ratios 
(SNH's)  below  the  threshold  of  the  optimum  detector,  suboptimum  detector  per- 
formance is  close  to  the  asymptotic  performance  of  the  asymptotic  receiver. 

It  is  convenient  to  define 

1 

and 
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2\  -P  2 / 

rr~  c “ / f(t)  cos  w t lit 

N / ' o 


(2-21 S) 
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2A  -P  2 l 

— e I r(t)  sin  ^ t dt 

1 o < 
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(2-21;)) 


: -t' 


12.  A Suboptimal  Detector 


Note  that  under  hypothesis  H , I and  Q are  zero  mean  statistically  independent 


Gaussian  random  variables  of  variance 


From  Appendix  A,  it  follows  that  under  hypothesis  H. , 1 and  Q are  asymptotically 


jointly  Gaussian.  From  Equation  (2-218) 


E { A cos  (w  t + m(t)j)  + n(t)  cos  oj  t dt  . (2 


With  reference  to  Equations  (2-221)  and  ( B — G ) , the  mean  of  I under  hypothesis 


where  double  frequency  terms  have  been  ignored.  Similarly,  the  mean  of  Q 


under  hypothesis  is  given  by 

HqIH  = E(QlH1)  = 0 . (2-223) 

The  second  moment  of  ] under  hypothesis  can  be  expressed  as 

2 2 T T 

e<i2|hi>  = \ir)  e'P/  / cos  Vi  cos  “oSj 

0 0 0 


E ( {A  cos  (00^  + na(t1) J + n(t1) } {A  cos  [00^  + m(t9)] 

+ n(t2)}  j dt1  dt2  . (2-224) 

From  Equations  (B-23),  (2-216),  (2-217)  and  the  statistical  independence  of 


m(t)  and  n(t),  it  follows  that 

E ^ { A cos  [w^  + m(t1)|  + n(t1)}  {A  cos  + m(t2)] 
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Substituting  Equation  (2-225)  into  Equation  (2-224)  yields 


E(I"lHi)  = (tH-)  ' 'Sj  f cosh  (Pe 
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where  double  frequency  terms  have  been  ignored.  With  the  aid  of  Equations 
(069)  and  (2-226),  it  follows  that  the  second  moment  of  I given  hypothesis  II 
can  be  written  as 


5(n4)  --2P-  «!*Ef 
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From  Equations  (2-227)  and  (2-222)  it  follows  that  the  variance  of  I given  H1 
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Similarly,  it  is  readily  shown  that 
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E(IQ|H.)  = 0 . 


The  suboptimum  receiver  of  Figure  2-12  forms  the  detection  statistic 


i = V r + q" 


(2-231) 


From  Papoulis  | 3J , the  p.  d.  f.  of  i given  hypothesis  H()  is  given  by 
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(2-232) 


where 


2 2 2 
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(2-233) 
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From  Miller  [25,  p.  30),  the  asymptotic  p.  d.f.  of  £ given  hypothesis 
follows  as 
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The  false  alarm  probability,  P 


FA 


, is 


PFA  / P<IH/L"VdL 


(2-235) 


where  y is  the  threshold  setting.  Substituting  Equation  (2-232)  into  Equation 
(2-235)  and  performing  the  integration  results  in 
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PFA  ■ “P[- 

\ o 


The  detection  probability,  PD>  is  given  by 

OO 

PD  / PUH1<LlHl,dL  ' 


y 

It  is  convenient  to  define 


a " nl|H1/ffI|H1  ’ 


b = y/u 


1 1 H 


c = o. 
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(2-239) 

(2-240) 

(2-241) 


U uQ|Hj  ' 

Substituting  Equation  (2-234)  into  Equation  (2-237)  and  making  use  ot  Equations 


(2-238)  - (2-241)  there  results 


PD  = C 


^ r(m  + p 

^ > i'(l/2)  r’(m  + 1)  d ^m+l(a’  * 

m =0 


(2-242) 
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where  Q.,(a,  b)  is  the  generalized  Q function 

IN 


QK(a,  b) 


2 2 „ 
e-(X  +a  )/2 


IK1(aX)  dX  . 


(2-243) 


From  Equations  (2-236)  and  (2-239),  the  parameter  b can  be  written  as 
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[-2<roinPFA] 


1/2 


llH, 


(2-244) 


2 

Consequently,  Equation  (2-242)  expresses  P^  as  a function  of  P , (A  /N_a),  P, 
and  aT.  Making  use  of  Equations  (2-220),  (2-222),  (2-228),  (2-229)  and  (2-238)  - 
(2-244),  miss  probability,  (P^  = 1 - P ),  is  plotted  in  Figures  2-13  through 
2-17  as  a function  of  the  time -bandwidth  product,  aT,  for  various  signal  to  noise 
ratios,  A /NQa,  and  the  fixed  false  alarm  probability,  P = 10  . Sub- 

optimal  performance  is  compared  with  the  asymptotic  performance  of  the 
asymptotic  receiver  in  Figures  2-18  through  2-21  for  parameters  of  interest. 
Note  that  suboptimum  performance  approaches  the  asymptotic  receiver  per- 
formance  as  the  signal  to  noise  ratio,  A /N  a,  decreases. 
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-13.  Miss  Probability  (P^  1 - PR)  vs  Time-Bandwidth  l'roduct  (uT) 

Parametric  in  Modulation  Index  (\  P)  for  a Signal  to  Noise  Ratio 
A2 

(SNR  rr— - ) of  -30  dB  and  I-'alse  Alarm  Probability  (P_,.)of  10 
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Figure  2-21.  Comparison  of  Optimum  Detector  and  Suboptimum  Detect,  i 
Performance  for  SNR  -90  dB,  PT, . = 10-3  and 
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CHAPTER  HI 


MMSE  ESTIMATION  IN  GAUSSIAN  WHITE  NOISE  OF  A NONLINEAR 
MEMORYLESS  FUNCTIONAL  OF  A RANDOM  PROCESS 
USING  NONLINEAR  OBSERVATIONS 
3. 1 Derivation  of  the  Volterra  Series 

Consider  the  problem  of  finding  the  minimum-mean  squared  error 
(MMSE)  estimate  of  a nonlinear  memoryless  functional  of  a random  process 


when  the  observations  have  the  form 

r(t)  = AS  [t,  m(t)]  + n(t)  0 t ^ T 

(3-1) 

and  the  MMSE  estimate  desired  is 

§ [ T,  m(T)]  = E { g [ T,  m(T)  ] I r(t);  O^tiT) 

(3-2) 

where  n(t)  is  zero-mean  Gaussian  white  noise  and 

E [nftj)  n(t2)  ] = no/2  5 (t^). 

(3-3) 

To  find  the  MMSE  estimate  m(t)  is  expanded  in  a Karhunen- 

-Loeve  expansion 

on  [ 0,  T]  . This  yields 
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L.I.M.  ^ 

m(t)  = y m 4)i  (t)  0 s t S T 
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i=l 

(3-4) 

where 

/ W2>W*2 

(3-5) 
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m{  = / m(t)  <f>.(t)dt 

•v 

(3-6) 

E [ m(t)]  = 0 

(3-7) 

Km(tl,t2)  = E [ m(tl)  m(t2^ 

(3-8) 
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The  Joint 

P<mv  ••• 


Probability  density  ftn,0ti„„ 
* Let 


(P»  d.  f. ) of  t 


N 

mN(t)  = ^2  mi  * j(t) 

i*=l 

and  consider 


mN  ts  denoted  by 


(3-9) 


rN(t)  = AS  ft,  mN(t)  j + n 


(t) 


Assuming  m,,  t»l N,  are  glye„,  r ,tl  m „ 

Loeve  expansion  to  obtain  ’ " ’*  6 expa"dotl  In  a Karhunen- 


(t)  Osts 


r ft)  = LIM 

N M— po  > r.  </> 

^1  } 

where  the  first  eigenfunction  Is  chosen  to  be 

1 1 

^ * jft)'  J ~2  are  chosen  arbitrarily 


(3-11) 
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t0  C°mp,ete  set.  clearly 


From  Equations  (3-13)  ami  (3-10) 
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K(rIlm1 mN>  = A|  S~  ^ mi  (t) 

L (=i 

Also,  from  th«  orthogonality  of  t/>  ^ (t ) and  Equation  (3-11) 

K(rj  I nij,  ....  mN)  =0  . J "2 

In  addition,  the  conditional  variance  of  r.  is  given  by 


(3-14) 
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It  follows  from  Equations  (3-1-1 ) through  (3-1(5)  and  the  Joint  normality  and  statistical 
Independence  of  t he  r ^ when  \ ! are  given  that 
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Applying  Hayes’  Ijiw  to  Equation  (3-17)  results  in 


• t I 1 1 • ’ * * ’ 1 M ' 


oxpJ-if  (rrAj/s“ft,mN(t)Jdt|')  +Sr?  |p(mi mN 

K) 

■ — ^ ~ jjj 

f.T.f  ‘’xpj-jf  ^rrAj/S“|t’mN^'|j'dt  j "5j.|>  jp(ml mN)d«nr..dmN 


let 
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The  expectation  of  g(T,  given  r.,. . . , rM  may  then  be  expressed  as 
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(3-20) 

Cancelling  common  faetors  in  the  numerator  and  denominator  of  Kquation  (3-20) 
and  taking  the  limit  as  M * «•  , the  conditional  expectation  becomes 
E {gpT.  mN(Ti]  | r(t);  0 - t - t} 
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Taking  lint  N-»  ”,  the  denominator  of  Equation  (3-21)  is  identical  to  Equation  (2-27) 


while  the  numerator  differs  only  by  the  factor  g(T,  ntN(T)).  Following  the  same 
procedure  used  in  developing  Equation  (2-28),  it  follows  that 
E { g[T,m(T)]  I r (t) ; 0-  t - T } 

, T T 
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where 


fj^l tj)  = E|S[t1,m(t1)]...s[ti,m(tl)]exp|-^-  j S2[T,  m(T)]  dT  } j , 

° (3-23) 

hj  (T, tj,  ...,t.)  = E /g[T,m(T)]  Sttj.mdj)]  ... 
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(3-24) 


Equation  (3-22)  - (3-24)  are  used  later  in  this  chapter  to  demonstrate  that  pre- 
viously known  results  can  be  obtained  by  this  alternate  approach.  To  reduce 
Equations  (3-22)  - (3-24)  to  a form  which  is  more  suitable  for  implementation  of 
the  estimator,  it  is  assumed  that  the  MMSE  estimate  of  g(T,m(T))  is  expressed  in 
terms  of  a Volterra  functional  expansion  according  to  the  relation 
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where  e^j-j,  ... , r.)  Is  the  i*h  Volterra  kernel  of  the  estimate.  Equating  Equations 


(3-251  and  (3-221,  there  results 
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Multiplying  both  sides  by  the  likelihood  ratio,  which  is  the  denominator  of 
Equation  (3-22),  (3-26)  becomes 
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Equating  terms  of  like  power  in  follows  that 
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In  Reneral,  e^tj t.i  is  Riven  l\v 
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Observe  that  e.(t  ^ ....  t.)  ean  be  obtained  explicitly  in  terms  of  hj(T,  t ^ t.i 

and  t'^dj tj.1;  i,k  0,1 i.  Consequently,  the  assumed  form  of  the  MMSK 

estimate,  Riven  in  Equation  (3-251,  is  valid. 

3.2  Hederivat ion  of  the  l. inear  Itesult  for  Zero  Mean  Oaussian  Processes 


In  this  section  it  is  assumed  that 
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where  nutl  is  a /ero-mean  llaussian  process  ami  tin1  desired  MMSK  estimate  is 
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From  Equation  (3-221  - (3-24 1,  ri\(Tl  is  Riven  by 
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Following  the  procedure  previously  used  in  Chapter  11  par.  2.  2, 
in  a Karhunen-l.oe’ve  expansion  to  obtain 
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F 


e\p 


(2ir  1 


N 


•> 


dm 


r 


. dm. 


0 


It  follows  that 

lyri  - o • 

Similarly, 


lyT.tji  K 


m(T)m(tjl  exp 


m”  ( rl  d t 


With  reference  to  Kquation  (2-4f>),  lyT, t ^ > is  identical  to  f„(T, 
Fquation  (2-4  ;>t  it  ts  concluded  that 


hj  (T.tji 


7T  n 

i=  1 


N 2 
o 


\. 


m(t ) is  expanded 


(3-4  1 ) 


N 


7T', 

.1=1 


(3-421 


(3-431 


(3-441 
t j i . From 


V!1  • l3"45' 


i se  of  Kquation  (2-58)  in  Kquation  (3-45)  results  in 


vr*v = 


* N /2 

TT  W^TTT 

i=i  ° 


N 


h.  (T.tll  • 


(3-4  r.) 


It  is  also  readily  shown  that 

h2(T.trt2>  = 0 


(3-47) 


h3(T*tl*t2’V  = 


N /2 

TTTnrnr 

i=i  ° 


■m 


[h,(T,t1)h,(t2,t3)  ^h*(T,t2)h*(trt3)  + h.a',t3)hf(t1,t2)] 

(3-48) 


In  general,  h.tT.tj t.)  is  given  by 


hjfT.tj t.)  = 


* N /2 

7T  N '2  * \ 
J=1  ° 


*) 


ill 

2 


= 0 , i even 


(3-49) 


y 


*■£ 
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when*  the  sum  is  overall  1'.  2 ways  of  partitioning  the  set 

f 1 • * 1 l|l  into  ^ pairs.  From  Equation  (3-49),  the  i,h  i-fold  integration 

in  the  numerator  of  Equation  (3-34)  ean  be  expressed  as 
T T 

J ' ’ ’J  r^j)  - • • rftjlh.fl',  tj,  . . .tj)  dtj. . .dtj 

o o 

ili 

o 

i-1 

M u ‘I  — 

O - 

T T 

f j r(t1)r(t2)h.(t1.t2)  dtj  dt„ 

.°  ° 


1 


h.H'.tjtrd 


i odd 


0 


i even 


f3-5t 


With  the  aid  of  Equation  (3-50),  the  numerator  of  liquation  (3-34)  becomes 
i T T 

H if  (jt)  /•••/r(t1)...r(ti)hi(T1t1 t.)  dtr..dt. 


i=0 


o o 


i=0 
i odd 


i-1 

9 

- T T 

(0  (ill) 

J J r(tj)r(t2)h,(t1,t2)  dtj  dt„ 

o o 

i-1 

o 


08  N ° 

7 T 


i=  1 


_ X. 

o i 


A T 

j h.(l',t1)r(t1)dt] 


N /2 

IT  — 

II  V o + 


i=  1 


N 2 *■  \. 
o 1 


5 T 


J h.cr.t^rd^dtj 


0XP(^~  / J r(tl)r(t2'h*(tl’t2)dtldt2  ) 

' ° o o ' 


(3-51) 


Substituting  Equations  (3-37)  and  (3-51)  into  Equation  (3-34),  the  expression 

A 

for  m(T)  reduces  to 
T 

m(T)=y*  h,(T,t1)r(t1)dt1  (3-52) 

o 

where  h,(T,t^)  is  the  solution  to  the  integral  equation 
T 


-f  h.fT.tj)  + f h,(T,  r^ir.tj)  dr  = Km(T,t1)  . 

o 

This  agrees  with  a well  known  result  [l,  Chapter  5 Equations  (23)  and  (17)] 


(3-53) 
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3.3  A Stochastic  Differential  Equation  for  the  Logarithm  of  the  Likelihood  Ratio 
In  this  paragraph,  a stochastic  differential  equation  for  the  logarithm  of  the 
likelihood  ratio  is  developed. 

From  Chapter  II  par.  2.  1,  the  likehood  ratio  is 


A (r(t>)  = 


r(t1)...r(t.)f.(t1, 


, t.)  dt j ... dt. 


(3-54) 


where 


••• . tj)  = E(S(tr  rnitj))...  S(t.,  m(t.))  exp 


(■</■ 


S (r , m(r))d t) 


(3-55) 


Observe  that  the  likelihood  ratio  is  a function  of  T.  Consequently,  we  consider 
the  derivative  of  A(r(t))  with  respect  to  T.  First  consider 


T T 

if  J fi  (t1>r(t1 ) dtj  = j fl(tl)J  r(t1)dt1  +fl(T)r(T)  . (3-5G) 

o o 


Similarly, 


T T 

WT  J /f2(tl*V  r(tl)r(t2)dtldt2 

o o 


/ 


T 

dT  f f2(tl’t2)r^t2)dt2 
o 


rftjjdtj 


T 

- r(T'  / f2rr.t2,r(t2>cit2  . 

o 


(3-57) 
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Slni't'  f.,it  j . t In  symmetric  In  It m arguments,  Ki|uatlon  (3-f>7)  simplifies  to 
T T 


Jv  If  f<j(tr*2)r(ti'r(t2>  l,ti ,u> 


o o 


T T 


J f f f-j(1  !•*_>'  r(t|)r(t2>  itt  j dt. 


o o 


T 


2r(T>  I f.jl'l'.t o' '■(!,)  dt.,  . 


(a-5H> 


More  generally,  it  ran  he  shown  that 
T T 


<t1)...r(t()fl(t1 t(t  dt,.  ..dt( 


o o 

t r 


/ ••/  [ Iff  fl<*l V ] r(t,)...r(tl) 


O o 


T T 


lr,T.  /.':!/  


I. 


-• 

ii 

-s 


I • 


M 


i 


"i 


:i- 14 


I’herefore,  the  derivative  of  A <i*(t > > with  respeot  to  T may  ho  expressed  uh 


Filiation  (A-tiO)  i a further  simplified  using  the  estimation  results 
Consider  the  MMSF  estimate  of  S(T,m(T)i,  then 
g(t,  m(t))  - S(t,  m(t))  . 

From  Filiation  (3-24),  h^T,  t j,  . . . , t .i  heeomes 

hjfl’.tj tt)  - K |s[T,  m(T)]  S It  . . . 


r <>  i i 

S[t(,  m(t()]  exp 

f 2 

- ij -IS  ( r , m(  r ))  dr 

o J 

L o J 

whieh,  from  Fixation  (3-23)  may  also  t>e  expressed  as 

hiv *•  * i V ' liti  (1,,t V • 

Substituting  Fiiuution  <3— 1»3>  into  the  numerator  of  Filiation  (3-22) 
that  the  seeond  term  of  Fquation  (3— tU>>  is  given  by 

r ""Eli  Gr)7!-/w‘A V 

t>  7 \ o/ 

i-0  o o 

- ~ r(  V)  S 1 l',  m(T)J  A | r(ti| 
o 


r(tj)  itt  j tit 

. r(t .idt j ... dt.  . 

(3-60) 
from  par.  3.1. 

(3-6 1 1 

(3-62) 

(3-63) 

, it  is  eoneluded 


(3-64 ) 


3-15 

4 


To  simplify  the  first  term  of  Equation  (3-60),  consider  the  MMSE  estimate  of 


S (T,m(T)).  Now 

g(T , m(T))  = S2(T,  m(T)). 
Observe  that 


(3-65) 


dT  fi(tl V "N  E 

o 


S2  [T,  m(T)]  Sftj.m^j)]  ... 


Sftj.m^.)]  exp  J S2[  r,  m(r)  ] dr^ 


“ N hi  (T,ti*  • • ••  V * 
o 


(3-66) 


Substituting  Equation  (3-66)  into  the  numerator  of  Equation  (3-22),  the  first  term 
in  Equation  (3-60)  is  expressed  as 
. T T 


l’.  (n  ) f’ ' f [dT  fi(tl ti)  ] r(t1)-',r(V 

i=0  V ° 7 o o 


.)  dt1# . .dt. 


A2  ^ 

= - g-  sM  T,  m(T)]  A [r (t)]  . 
o 


Combining  the  above  results  Equation  (3-60)  becomes 

d A2  ^ 

3fA[r(t)]=  -g-  SZ[T,m(T)]  A[r(t)] 
o 


+ ~ r(T)S[T,m(T)]A[r(t)] 
o 


(3-67) 


(3-68) 


r 

1 

■ 
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Dividing  both  sides  of  Equation  (3-68)  by  A(r(t))  it  is  recognized  that 

fn  (A(r(t))  = { r(t)  AS  (T,  m(T))  - | A2  S2[T,  m(T)]  } • (3-69) 

The  result  in  Equation  (3-69)  is  consistent  with  the  use  of  the  Stratonovich 
stochastic  integral  implied  in  pars.  2. 1 and  3. 1 where  integrals  were  manipulated 
using  the  ordinary  integral  calculus.  Equation  (3-69)  is  easily  modified  to  be 

A 

consistent  with  the  use  of  the  Ito  stochastic  calculus  via  addition  of  the  correction 
term 

jf-  jA2?[T,m(T)]-  A2S2[T,m(T)]  } 
o 

as  pointed  out  by  Duncan  [ 18]  to  obtain 

' n { A [r (t)]  } = AS  [T,  m(T)]  |r(T)  -±  AS[T,m(T)]  } . (3-70) 

This  latter  result  was  obtained  by  Kailath  [6]  using  the  Ito  stochastic  calculus. 
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3.4  MMSE  Estimation  in  Gaussian  White  Noise  of  a Nonlinear  Functional  of  a 


Zero  Mean  Gaussian  Random  Process  Using  Linear  Observations 
In  this  section 

r(t)  = m(t)  + n(t)  0<  t<  T 

where  m(t)  is  a zero-mean  Gaussian  process  with  autocovariance 
Km(tl,t2)  = EfmftjJmitg)) 

and  where  n(t)  is  zero-mean  Gaussian  white  noise  with 

N 

EWtjinitg))  = -f  6 (tj-tg) 

The  MMSE  estimate  desired  is 


g(T,m(T))  = E(gfTfm(T))|r(t);0<t<T) 
From  Equations  (3-22)  - (3-24) 


oo  i 

J*--i-J*r(t1)-  -r(t.)h.(T,t1,...,ti)  dtj... dt. 

g(T,  m(T))  = ££ — ° T-  T 

00  i 1 1 

f-fr^..rWl Vdt^dtj 

i=0  ' o o 


where 


fjftj tt)  = E jmftj). 


. m(tj)  exp 


and 


hjCT.tj t,)  = 


E 


^g(T,  mCTjJm^j). . .m(t.)  exp 


(3-71) 

(3-72) 

(3-73) 

(3-74) 

(3-75) 

(3-76) 

(3-77) 


18 


The  denominator  of  Equation  (3-75)  is  recognized  as  the  likelihood  ratio.  From 
Equations  (2-56)  and  (2-58)  the  likelihood  ratio  is  expressed  as 


i T T 

12  ft  (f)  /!/r(t i)...r(ti)fi(t1,...t1)dt1,... 

1=0  V (>/  o o 


dt, 


N /2 

7T  N '2  + \ 
1=1  ° 1 


exp 


T T 


if  / /r(ti>r(t2)h*(tl*t2)  dtldt2 


o o 


(3-78) 


where  hjtj.t^  is  given  by  Equation  (2-57).  The  numerator  of  Equation  (3-75) 
must  be  treated  separately  for  each  choice  of  g(T,  m(T)).  As  an  example,  let 


g(T,m(T))=  ni  (T) 
For  this  case 

hQ(T)  = E ( m“(T)  exp 


(3-79) 


f ~ if  f m2  (7-) 

' ° o 


(3-80) 


With  reference  to  Equations  (2-45),  (2-49)  and  (2-58)  it  follows  that 


h0(T)  " 


N /2 

TT  N /2  f \, 


i=l 


N 


-T  \<T,T) 


(3-81) 


Similarly, 


hjlT.tj)  = 0 . 


(3-82) 
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...  .... 


Also,  from  Equations  (2-52)  and  (2-58), 


h2(T,tl,t2)  " 


N /2 


i=i  ° 


+ 


(t)  [h*rr.T)h,(t1,t2) 


+ 2h,fr,tl)h,(rft2)]  . 

To  proceed,  it  is  readily  shown  that 

^•‘rW  = 0 


h4(T,t1*t2’ 


W 


IT 

i=l 


N /2 
o 

N '2  + 
o 1 


1 

2 


[h,(T,T)ht(trt9)h,(t3,t4) 

+ h,(T,T)h,(t],t3)h,(t2,t4) 

+ h*(T,T)h,(t],t4)h,(t2,t3) 

+ 2h*fT,  tl)h*(X.t2)h#Ct3.t4) 
+ 2h,(T,t1)h+(T,t3)h+(t2,t4) 
+ 2h,(T,t2)h%(T,t3)h,(tlft4) 
+ 2h.(T,t1)h,(T,t4^h,(t2,t3) 
+ 2h^(T,t2)h,(T,t4)h,(tlft3) 
+ 2h,(T,t3)h,(T,t4)h,,t]ft2)] 


I 
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(3-83) 


(3-84) 


(3-85) 


and  so  on.  In  general,  h.(T,t1 t.)  is  given  by 


hif.'j 'l**  7 T 


V2  5 (No) 

N /2fL  \ 2 / 


o j 


Eh,  (T, T)h,(t  ,t  )...h,(t  ,t  ) 

J1  32  Ji-1  ]i 

Eh,fT,t  )h,(T,t.  I...h*(t  ,t  ) 

31  ]2  ]i-l  ]i 


i even 


= 0 , i odd 


(3-86) 


where  the  first  sum  is  over  all  i'./2  ^ It)',  ways  of  partitioning  [t^,  . . . ,t.] 

' i/2  ( i \ 

into  pairs  and  where  the  second  sum  is  over  all  i*  i 1/2  \ 2 / ' wa^s 

partitioning  [T,  T,  t^,  . . . , t.]  into  ^ + 1 pairs  not  included  in  the  first  sum. 
From  Equation  (3-86),  the  ith  i-fold  integration  in  the  numerator  of  Equation 


(3-75)  can  be  expressed  as 


T T 


/.i.y"r(t1)...r(t.)hi(T,t1,...t.)dt1...dti=  7T No/2° 
n n 1=1 


(W 


h,(T,T) 

*(*)•. 


r(t1)r(t2)h,(t1,t2)dt1dt2 


J rftjth^fT, 


f(t  ^23^i^^2 


(3-87) 


, i even 
= 0 , i odd 
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From  Equation  (3-871,  it  follows  that  the  numerator  of  Equation  (3-751  is 


T T 


yi  ii  (n  ) r(x  i),"r(ti)hi(i,ti 1 

l-rt  ' ° ‘ n r> 


... . tj)  dt1...dti 


N /2 

77”  n 2 ► \ h 

j=l  ° J 


on 

•fr'T1L^7rrfc 


' 1/2-1  V o 
i=0  2 \2  ' 

i even 


r(t1ir(t,,lh,(t1,t2)  dtjdtg 


(t 


i even 


r(t1>r(t2lh,(t1,t2l  dtj  dt2 


Reducing  the  summations  in  Equation  (3-881  to  closed  form  results  in 


T T 


Eir  (f)'  P/r<V" 


r(tjlh.(T,t1 tp  dtj...dtj 


(3-881 


N /2 

77” N 7 2 * 


h.fr.Tl  f | r(t1lh,(T,t1ldt1 


I 1 

exp  IT  / /r(tl)r(t2)h*(tl,t2)  dtidt2 


(3-891 


3-22 


From  Equations  (3-75),  *3-7S),  and  (3-Si))  the  MMSF  estimate  of  m“(T)  is 
given  by 


m“(T) 


N 

-TT  h.(T.T) 


T 

f h.(T.  t j )r (t  j Kit  j 
o 


•> 


(3-90) 


However,  from  Kquation  (3-52) 

T 

m (T)  = j h,(T,  tj)r(tj)  dtj  . (3-91) 

o 

Furthermore,  it  is  known  that  (l) 

{ (T)  = F | [m(T)  - m(T)]  ' r (t  > ; 0 - t - r } 

N 

= -£■  h*(T,T)  . (3-92) 

Hence,  Equation  (3-90)  may  be  expressed  as 

m“  (T)  = f (T)  * m “ (T)  (3-93) 

which  is  in  agreement  with  Olsen  [si  . MMSF  estimation  given  by  Equation 
(3-74)  using  the  observation  Equation  (3-71)  has  been  studied  by  Olsen  [5]  using 
a technique  much  more  efficient  than  the  one  presented  here.  For  this  reason, 
no  further  consideration  will  bo  given  to  this  class  of  MMSF  estimation  problems 


3.  5 Systems  of  Differential  Equations  Describing  the  MMSE  Estimate 

In  this  section,  Equations  (3-22)  - (3-24)  are  used  to  obtain  differential 
equations  for  g(T,  m(T)).  Two  examples  are  considered.  In  the  first,  the 
method  is  illustrated  by  considering  a linear  example  for  which  g(T,  m(T)) 

AS(T.  m(T))  m(T)  where  m(t)  is  a zero-mean  Gaussian  process  with  a first- 
order  Butterworth  spectrum.  Using  results  derived  by  Olsen  [ 5]  , the  Kalman 
filter  equations  are  obtained.  In  the  second,  a nonlinear  example  is  considered 
for  which  g(T,  m(T))  AS(T,  m(T))  = in*-!!')  where  m(t)  is  a zero-mean  tiaussian 
process  with  a first-order  Butterworth  spectrum.  It  is  shown  that,  since  results 
comparable  to  those  obtained  by  Olsen  for  the  case  AS(T,  m(T))  m(T)  are  not 
a\ailable  in  the  more  general  nonlinear  case,  the  system  of  differential  equations 
contains  an  infinite  number  of  equations. 

3.5.  1 A Linear  K 'ample:  First-Order  Butterworth  Process 

In  this  section,  the  Kalman  filter  equations  are  derived  for  the  MMSE 
estimate  of  a zero-mean  Oaussian  first-order  Butterworth  process  in  Gaussian 
white  noise.  The  observation  equation  is 

r(t)  m(t)  +-  n(t)  . OitsT  (3-i>4) 

where 


Km(tU  t2)  E 


mitj)  m(t2) 


-alt  -t,l 
Pe 


and 


K n(tt)  n(t2) 


N 

~2  ^ l " ^ ’ 


(3 -‘35) 


(3-3t>) 


The  MMSE  estimate  desired  is 

giT.  m(T))  = m(T)  . (3-37) 

From  Van  Trees  L 1.  p.  547]  . m(t)  can  be  realized  by  the  differential  equation 
m(t)  = - a nt(t)  + w(t)  (3-38) 

where  w(t)  is  a zero  mean  Gaussian  white  noise  process  with  autocorrelation 

Etw^)  w(t2))  2u  P c^tj  t2)  . (3-33) 


U 


3-24 


Krom  Equations  (3  22)  (3-24).  the  MMSK  estimate  of  ni(T) 

, T T 
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111(1) 


J2  ‘ (n^)  /•■■/  rltI)  r(tj)  hjtT,  I, t,)  dt,... 

t 0 O O 


itt. 


_o 0_ 

T T 


HiV(f-)  } ' j r<V-r‘VV, ydt,... 

i 0 o o 


(3-100) 


Ot. 


where 


hjfT-  l()  E Jni(T)  nHtj)  ...  ni(t  ) exp 


T 


PT  /,n‘ 

o J 


(T)  dr 


(3  101) 


and 


r j 1 

) 

fi(tr  •• 

"V  E 

m(tl'  •• 

. m(t.)  exp 

1 2,. 

N~  1 m (t)  dr 

0 J 

0 J 

( 

1 

(3  102) 


Recognizing  the  denominator  of  Equation  (3  100)  as  the  likelihood  ratio.  m(T) 
eati  be  written  as 


T T 
i c 


m A il:  (n0  ) J • ■ Jr{t  i>  - r<V  hi<T-  li V ...  lit, 

i 0 o ii 


(3  103) 


o o 


where  the  argument  of  ni(T)  and  A (r(t))  have  been  suppressed  for  notational 
economy . Taking  the  derivative  of  Equation  (3-103)  with  respect  to  T and  making 
use  of  Equation  (3-30).  there  results 


T T 


m 


k r,T)Eir(ir)  /”•/'» I’-r'VVlT.T.t, i,t 

r 0 o o 


A 


\ T T 

+ £ <V  (it)  /* 1 i nti)-  r(V  ki(T-  ‘i V 


(3-104) 


where  the  "dot"  denotes  -77  . 

d l 


Jg* 


From  Equation  (3-101)  it  follows  that 

*VT-  V N~  K jm'Vl')m(t1)  ...  m(tj)  exp  jp  f ni‘(T) 

° / o J 


1 

. ;r 

I [ - om(T)  + w(T)  j nt(t  ^)  ...  m^)  exp 

1 

"ro 

1 

(3  105) 


Sitn  e r.i(t)  and  w(T)  are  statistical^  independent  for  t < T it  follows  that 

r t 


VT*  ll V ff"  v ni3(T)  m^tj) ...  m\t.)  exp  - ~ j m2(r)dr  ( 

* I [ *.  J 


T 


i r o 

- o K , ni(T)  mftj) ...  m(t.)  exp  - J m"(T)  dr 


o 

L o 


(3  100) 

C onsider  the  second  series  in  liquation  (3-104).  Substituting  Equation  (3  100) 
back  into  this  series  and  making  use  of  Equations  (3-22)  - (3-24)  there  results 


T T 


rr(f*l  /•••/r<v-  r*v  VT-  ir 

i 0 ' 1 1 o o 


. t.)dt1...dtj 


N 


1 ' 3s . 

m A - o m A 


(3  107) 


Similarly.  h.f  ^ (T,  1'.  t^ t.)  can  be  written  as 


(3  l OS) 


From  Equation  (3-108)  and  Equations  (3-22)  - (3-24),  the  first  series  in  Equation 
(3-104)  is  given  by 


, T T 


X)  IT  ( tH  /• ! / r<‘l>  - ■•(•,)  N+1(T.  T,  l, t.)  dtj  ...  dt( 

i-0  ' o o 


/2V 

= m A 


(3-109) 


From  Equation  (3-68) 


A = TT~  + ~~  r(T)  m A . 


N 


N 


(3-110) 


Substituting  Equations  (3-107),  (3-109),  and  (3-110)  into  Equation  (3-104)  there 
results 


m = -a  m + 


N 


/ ^ - 2\  1 
(m  - m J r(T)  -f 


'/3'  1 // 


m + 2 m m 


(3-111) 


From  Olsen  [5,  Table  2.  2] 

/3s 


m”  = m ( 3 m2'' -2  m2  j . 

Substituting  Equation  (3-112)  into  Equation  (3-111)  yields 

~ 2 / /2S  ~ 2\  f /v  \ 

= - a m + — ^ m -m  j fr(T)  - mj. 


(3-112) 


m 


(3-113) 


To  proceed,  it  is  necessary  to  derive  a differential  equation  for  m2^-  m 2 

To  accomplish  this,  a differential  equation  is  first  derived  for  m^  Let 
2 

g(T,  m(T))  = m (T),  then  from  Equations  (3-22)  - (3-24)  it  follows  that 


m A = 


T T 


w i 

£ TT  (ir)  /"*/  r(t1)-  r<V  ht(Tf  tx tjldtj...  dt. 


o o 


(3-114) 
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: - . I .ki.. . . 


-.3 


1* 


n 


H 


i j 


-■ 


w ht>  rt » 


ll 


Noto  that  IxMh  m(T)  and  \v(T)  appear  in  the  second  expectation  In  Equation  (3-117). 
Equation  (3-117)  can  ho  written  as 


",  fr. 


1 

1 

T 

| m * (T)  ni(tj) ...  in(tj)  exp 

" f m“(r)dr 

o J 

l 

. o 

2 o K 


in“(T)  mltj) ...  m(t.)  exp 


T 


' n;/'”2 


( r)  dr 


(-w 

j 0 ' ° 


I’  ’I’ 


o o 


K w (T)  m (T)  m (tj ). . . m (tj  )m2  (tj  +1 ). ..  m2  (tj  ) 


lltitl**,dti+| 


Note  that 

E Jvv(T)  ni(T)  m(t1)  . 


(3-118) 


- E Jvv(T)  ni(T)l 


* terms  involving 
Since  w(T)  and  m(tk);  k-1,  . 


• «»“(t1#1)  ...  m2(t1+J)J 

md,)  ...  m (tj)  m2(t1(1)  ...m2(t1+J)j 
w(T)  m(tk)j  ; k 1 i,  j 


(3-115)) 


it.i;  are  statistically  Independent,  only  the  first 
term  in  Equation  (3-1151)  is  nonzero,  aibstitutlng  Equation  (3-1 151)  into  Equation 
(3-118)  and  recalling  from  Van  Trees  [l,  p.  532]  that 

E [w(T)  m(T)]  = (v  p. 


(3-120) 


it  follows  that 


( I . tp  •••  fj)  ~ n ^ 
o 


-2i»£ 


m fr)m(t1)...  m(tj)  exp 


1 f m2 

'X Jm 


(t)  c!t 


2 

T 

1 f 2 

m (T)  m(t1) ...  m(t4)  exp 

' N~  1 m (T>  dT 

o J 

o 

+ 2o  P fj  (tx tj)  . (3-121) 

Substituting  Equation  (3-121)  into  Equation  (3-11(5)  and  making  use  of  Equations 
(3-22)  - (3-24)  and  Equation  (3-68)  there  results 

n . XX  1 . 2 /N 


m = - 2 a m - -rr~  m + 2 a P + -tt—  r (T)  m° 
N N 


+ m " k“  r<T)  m m 


1 2 

N m " N 
o o 

From  Olsen  [5,  Table  2.  2] 


XX  Xfc£  ~ 4 
m -3m  -2m 


o 

/iN 


(3-122) 


(3-123) 


//2> 


Substituting  Equations  (3-123)  and  (3-112)  into  Equation  (3-122),  m is  given  by 


XX 

m“ 


* xx  2 r / 

, -2am2+1f  (3 

o L ' 


A XX  A1) 

mm  - 2 rn  -mm  ) r (T) 


//X 

■^^2  a 4 \ ' 

1 

(m 

-3m  + 2m  1 

J + 2<v  P . 

(3-124) 

Let 


XX  -v  2 

£ — m“  - m 


(3-125) 


It  follows  that 


r 


Mihstltuting  Kquation  (3-12-1)  ami  (3-1 13)  Into  liquation  (3-12C)  yields 


- A 2 l 

£ -2am  f 2 a m“  ♦ — 

N 


o 


in 


- . 'IN ' - ~ i 

t 2 ill  i -I  m m - I in 


• 2d  1* 


r * 2d  p 
o 


(3- 127) 


ftinumirl/.ing. 


in  -n  in  i 


N 


i'(T)  - in 


£ - rf 


i-  2 o P 


o 


(3-128) 

(3-129) 


in  agreement  with  well  known  results  [l]  . 

Uelutions  like  Kqua  lions  (3-112)  ami  (3-122)  are  not  generally  available  and 
(lie  system  of  differential  equations  eannot  be  reduced  to  a finite  system  oi  equa- 
tions as  in  the  linear  case.  A nonlinear  example  which  leads  to  an  infinite  system 
of  equations  is  considered  in  the  next  section. 

3.  3.  2 A Nonlinear  Example  - Squared  first -Order  Mutterworth  Process 


In  this  paragraph,  a nonlinear  observation  equation  is  considered.  In 
particular,  the  received  signal  is  assumed  to  be 


r(t)  m~(t)  * n(t)  , <*_  t 1 T (3-130) 

where  ni(t)  is  a zero  mean  Caussian  process  with  first -order  Mutterworth 
autocorrelation 


Km<tr  *•>»  ,’t’ 


- “ I * 1 -u 


(3-131) 


• i 


!l 


! < 

H 


I 


I! 


i 1 

I 


r. 
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and  where  n(t)  is  zero  mean  Gaussian  white  noise  with  autocorrelation 


N 

E[n(tx)  n(t2)J  = -f-6(tl-t2) 

The  desired  MMSE  estimate  is 

/\ 

kit,  m(T)J  = m2(T)  . 


(3-132) 


(3-133) 


The  objective  is  to  obtain  a system  of  differential  equations  whose  solution 
yields  g(T,  m(T)  ).  From  Equation  (3-  22)  - (3  - 24),  the  MMSE  estimate  of 


m“(T)  is 


A 


T T 


m (T)  = 


SlT  (^r)  f rtfj)...  rtyhjOT.tj t1)dt1...dtJ 

i -0  ° o o 


_o o 

T T 


i 

2^7t(rr)  / •1*- / r<t1)***  t1)dt1...dti 

i =0  ° 0 « 


(3-134) 


where 


hj(T,  tt tj)  = E 


m“(T)  m2(t1). . . m“(t.)  exp 


i 

.j.  r 

Nn  J 


m (r)  d r 

(3-135) 


and 


I 

T 

) 2,,  , 2 

i r 4 

j ni  (t^). . . m (tj)  exp 

~ rT  1 m (r)  dr 

1 

L 0 j 

. (3-136) 
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Recognizing  the  denominator  of  Equation  <3 - 1 :M ) as  the  likelihood  ratio, 


ni“(T)  can  be  written  in  the  form 


T T 


A it  (if)  / / r< t1)...r<ti)hi<T,t1 t4) dtj. . 


0 0 


(3-137) 


Taking  the  derivative  and  making  use  of  Equation  (3-59)  yields 
/\  A * , T T 


0 0 


r (tj ). . . r(tj)  hlfl(T,  T,  tj t})  dt^.dtj 


T T 


Srr(if)  J ■■■/  r<ti>--  r<*i> 

1 l\  ^ A .t 


0 0 


lijl'l'.  tj tt)  dtj. . . dtj 


(3-138) 


From  Equations  (3-135),  (3-98)  and  the  argument  leading  to  Equation  (3-121) 


it  follows  that 


*!■  • • • V = " PT  K I mt  (T)  nrV1). . . mJ(t()  exp  - ~ J m4(r)  dr 


-a*  E jm“(T)  m“(t1)...nr(t.)  exp  - ~ f m4(r)  dr 

( L ° 0 J 

r r i j 

t^»PE  nT(tj). . . m“(tj)  exp  ~ I m4(r)  dr  J . 

° 0 

U J I 


(3-139) 
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Also, 


T 

hi+i(T’T,ti V ~ E 

m4(T)  m(t^). . . m(t.)  exp 

“ jf-  f m4(r)  dr 
. °o 

(3-140) 

Substituting  Equations  (3-140)  and  (3-139)  into  Equation  (3-138)  and  making  use  of 
Equation  (3  -22)  - (3-  24)  results  in 

2 /4s  1 y^ 

m A + m A - — r(T)  m A - — m A - 2a  m A + 2a  P A . (3-141) 

o o 

From  Equation  (3-68) 

1 2 

A="N~m  A+n“  r<T>  m A • (3-142) 


Substituting  Equation  (3-142)  into  Equation  (3-141)  and  simplifying  yields 


m = (m4-m2  ) r(T)  + (m’  m‘  -'V7 


+ 2a  P 


(3-143) 


Similar  results  can  be  derived  for  m4  and For  m^  let  g(T,  m(T))  = m4(T) 
From  Equations  (3-22)  - (3-24)  it  follows  that 


m A 


i =0 


i x x 

f i r 

U ) 

J **•  J 

u 

0 0 

. . dt. 
(3-144) 


where 


ht(T,  tv . . . tj)  = E 


T 

1 

m4(T)  m2(t^). . . m2(t ) exp 

“ iT  1 m4<T>  dT 
°o 

(3-145) 
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Taking  the  derivative  of  Equation  (3— 1*14 > there  results 


m A * m A r(T)  in  A 


^^i'  (no)  J’”  j r<V*  • • rftj)  hjfl,  tx tj) 


. T 1 


i 0 


o o 


lit ... . tit.  . 
1 i 


(3-140) 


From  Filiations  (3-145)  and  (3-38),  the  derivative  of  lyT,  tj,...,  t.)  is 


given  in 


1 


'V  1 ’ ll V N K 

o 


in'  (T)  m^(tj). . . m^t  ) exp 


1/  4 

-} r / m (r)  dr 
° i 


/ 

T 

) 

1 4 2 , 2 

1 / 4 

j in  ( 1 ) m (tj).  . . in  (t{)  exp 

" n“  1 m (r)  dr 

O \ 

\ 

I 

0 

) 

T 

' 

3 2 

1 m (T)  vv(  1 ) in  (tj ). 

•) 

. . m“(t  ) exp 

1 1 4 

‘ pT  J m <r'dr 

o -f 

[ 

0 

(3-147) 

l’o  simplify  the  last  term  of  liquation  (3-147),  first  expand  the  exponential  to 
obtain 

T 


3 


E (in  (T)  \v(T)  in  (t  j ).  . . m~(t, ) exp 


- r rj  m4(r)  dr 
L °o 


T T 


S F (‘  fr)  / •••  I K(«»,l(T)  w(T)  m“(t1)...m2(tt)  m4(tia)... 


0 0 


m (t.  .) ) dt.  ....  dt.  . . 

' irj  itl  i • j 


(3-148) 
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1 


Since  w(T)  and  m(t)  are  independent  for  t < T it  follows  that 
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E|ma(T)  w(T)  m^tj).  ..m^tj)  m’(ti+1>. . . m‘(t1+J)l 


2 . . 4, 


= 3 E|  m(T)  w(T)l  E(  m2(T)  m2(t1). . . m^tj)  nr(tJ+1). . . m'lt^)) 

Substituting  Equation  (3-149)  into  Equation  (3- 148)  it  follows  that 
h.(T,  t^ tj)  can  be  written  as 


2 4 


(3-149) 


j 

T 

j 

18  2 2 
m (T)  in  (t1). . . m (t.)exp 

' rT  f m4(r)dr 

° 0 

1 

- 4 a E 


4 •>  2 

m (T)  m"^). . . m (tj)  exp 


T 


i \ •' 


m (r)  dr 


j 

T 

l •>  ■>  2 

1 f 4 , 

m“(T)  m“(t1). . . m“(tj)  exp 

- — m (r)  dr 

o \ 

[ 

0 

(3-150) 


Substituting  Equation  (3-150)  into  Equation  (3-146)  and  making  use  of 
Equations  (3-22)  - (3-24)  and  (3-142)  results  in 

^ 2 ' 6X  x >'4' 


2 ' o' 

m = - 4 a m i - t~  (m  - m m ) r(T) 
N 

o 


1 /)v  /^S 

» — ( m - m ) * 12a  P m 
o 


(3-151) 


In  general,  m“  can  lie  written  as 


- J nn  Ill 


n • h ///^1  '/2n 


- m in  1 r(T| 


. A />  /N 

I Jn  J(ii  >3  i , , , n- 1 > 

t 111  in  - III  ) • (L’li)  (L’ll  - 1|  II  1'  111  ' 


(3-1531 


tor  n 1,  . . Kquation  (3-15:.'i  represents  an  infinite  si  stem  of  coupled 

nonlinear  (iilterential  equations  tor  estimates  of  tin.'  monients  of  m“(Ti 
conditioned  on  the  observation  record  iqtl;  d t _ T.  Approximations  to  the 
solution  ot  Kquation  (3-1531  mav  lie  obtained  by  assuming  a value  for  N such 
that  in  ii  tor  n _ N or  b\  assuming  a particular  form  for  the  conditional 
o.  d.  t.  ol  in  t 1 ) given  r (t > : 0 t _ I',  so  that  higher  order  moments  can  be 
expressed  in  terms  ot  lower-order  moments.  These  techniques  have  been 
applied  | 3)  with  some  success. 

3.i>  MMSK  Kstimation  lor  vie  Processes  - An  Kxample:  Kstimating  the 
Phase  of  a Sinusoid 

Detection  of  nonlinear  memoryless  functionals  of  dc  processes  was 
considered  in  par.  3.3.3.  In  this  paragraph,  the  estimation  problem  is 
considered.  For  the  special  ease  of  dc  processes 


mtti  m 


0 - t T 


(3-1531 


where  the  probability  density  function  tp.d.  f.  ) of  m is  given  In  p (M».  Since 
there  is  only  one  term  in  the  Kurhunen- l.oeve  expansion  of  ni(t),  it  follows 


3-37 


* 


from  Equation  (3-18)  that  the  conditional  p.d.  f.  of  m conditioned  on  Uie 

measurement  record  r(t)  A S(t,  m)  + n(t),  0 <_  t <_  1 , is  given  by 

p (M  | r(t);  0 < t < T) 
m - - 


exp 


T 2 T 

YT  f r<‘>  M>  dt  - J 

° 0 ° 0 


M)  dt 


P (M) 
m 


dO 

| T 2 T 

J oxp 
- 00 

f r(t)  S(t,  M)  dt  - j SJ(t,  M)  dt 

! ° 0 ° 0 

p (M)  dM 
m 

(3-154) 


As  an  example,  consider 

S(t,  m)  cos  (lo  t + m)  (3-155) 

and 

Pm(M)  ~ , 0 < M < 2 Jr 

0 elsewhere  . (3-156) 

The  observation  equation  is  then  given  by 

r(t)  A cos  (^  t * m)  *•  n(t)  . (3-157) 

' o 

Estimation  of  a constant  random  phase  angle  of  a sinusoid  embedded  in  additive 
white  Gaussian  noise  has  been  considered  by  Abbate  and  Schilling  | 36  ) and  also 
by  Babcock  l 27  1 . In  this  section,  after  obtaining  an  expression  for  the  MMSK 
estimate  of  m,  performance  of  the  estimator  is  derived  using  a new  approach. 
The  method  used  in  this  paragraph  for  deriving  the  estimator  and  its  perform- 
ance is  more  efficient  than  is  the  Volterra  functional  expansion. 


3-38 


Substituting  Equations  (3-155)  and  (3-156 ) into  Equation  (3-154)  there 


results 


Pm(M|  r(t);  0 < t < T) 


2A 

xp ! C J 


A2  ( 

I J r(t)  cos  (u^t  + M)  dt  - — J cos"  (uQt  + M)  dt 


2?r  f 


A"  C 9 

ex  1 r(t)  cos  (^t  + M)  dt  - I cos“  (u)  t + M)  dt  ! d? 

A J 


, 0 < M < 2n 

- 0 , elsewhere  . (3-158) 

From  Equation  (3-158)  and  the  development  leading  to  Equation  (2-113)  it 
follows  that 

P (M I r(t);  0 < t < T) 

2A  A2'!’  sln 

exp  (I  cos  M - Q sin  M)  - • cos  (w  T + 2M) 

o “l  o o1 


, A.  S‘"  V \ n2  »/2 

""  ol  2N  W T ) o N + ^ ) 

\ o o / o 


sY'  , ( A2T  Sln“oT\  2A 

■ if-;  k V 2No  %,T  J 2k  _N„ 

cos  k 12  tan  1 ^ T) 

I O J 


2 2 

(I  + Q2) 


, 0 < M < 2tt 

, elsewhere 


(3-159) 


whore 


J r(t)  cos  uj^t  dt 


(3-160) 


Q 


T 


J*  r(t)  sin  u^t  dt 


(3-161) 


For  - T iit,  n / 0,  or  T >>  1,  Equation  (3-157)  simplifies  to 


exp 


p (Ml r(t);  0 < t < T) 
m — — 


1 (1  cos  M - Q sin  M) 
IN 

O 


where 


2r  I 


o 

0 < M < 2tt 

elsewhere 


(3-16  2) 


AT 


(3-163) 


Q AT  Q 


(3-164) 


From  Equations  (3-157),  (3-160)  and  (3-163),  the  mean  of  1 conditioned  on  m is 
given  by 

T 

(3-165) 


E(llm) 


—=  I A cos  (vj  t + m)  cos  u)  t dt  , 
AT  J o o 


0 
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Carrying  out  the  integration  in  Equation  (3-165)  there  results 
E(I  I m)  = cos  m . 

Similarly,  the  second  moment  of  I conditioned  on  m follows  as 


T T 

A 1 0 0 


A cos  (w  t,  + m)  cos  (w  t + m) 
o 1 o 2 


N 

+ ■# 6 (ti " V 


cos  w t,  cos  w t„  dt,  dt„  . 
o 1 o 2 12 


(3-166) 


(3-167) 


Carrying  out  the  integration  in  Equation  (3-167)  yields 
-2  2 - No 

E(I  |m)  = E (l|m)4  . (3-168) 

AT 

From  Equation  (3-168)  it  follows  that  the  variance  of  1 conditioned  on  m is 
given  by 


(3-169) 


Similarly,  it  can  readily  be  shown  that 
E(Q|m)  = - sin  m , 

9 

<rQ  I m = -Jfa 

E(Tq| m)  = E(l|m)  E(Q|m)  . 


(3-170) 


(3-171) 

(3-172) 


Since,  given  m,  I and  Q are  jointly  Gaussian,  Equations  (3-166)  and  (3-169)- 
(3-172)  completely  describe  the  statistics  of  I and  Q. 
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The  MMSE  estimate  of  m is  the  conciitional  mean  of  m given  r(t); 
0 " t v T.  Therefore,  from  Equation  (3-16  2), 


i-  f 

2JT  J 


9jr  exp  1 (I  cos  M - Q sin  M) 
r o 


(3-173) 


E(|uation  (3-173)  is  useful  for  obtaining  the  conditional  bias  and  variance  of 
m by  numerical  integration.  The  integration  in  Equation  (3-173)  can  be 
carried  out  bv  first  considering  the  generating  function 


exp  (Z  cos  0)  IQ(Z)  + 2 1R(Z)  cos  kO  . 


(3-174) 


Substituting  Equation  (3-174)  into  liquation  (3-173)  there  results 


m = 7T  + 


J_  r 

Z-r  I (H)  2 ir  J 


M cos  (k(M  t ()))  dM 


(3-175) 


where 


R 3T2'  vr2+Q2 

o 


(3-176) 


-1  Q 

0 - tan 


(3-177) 


From  the  C.  It.  C.  tables  [28,  Equations  389,  393| 
~ J M cos  |k(M  + 0)1  dM 


cos  k« 


rJ 


M cos  kM  dM 


2 7 r 


sill  kO  I M sin  kM  dM 


^ sin  kd  . 

K 

Substituting  Equation  (3-178)  into  Equation  (3-175)  yields 

»k< 


(3-178) 


a lk(R) 

m rr  i 2 7 -----  sin  k 0 


L klJK) 

k 1 


(3-179) 


O A 

Note  that  for  A T/N^  0 (no  observations),  H 0 and  m jt,  the  a priori 

estimate.  Also,  for  A^T/N  * (observations  on  ( 0,  -»|  ),  it  follows  that  the 

variances  of  1 and  Q are  zero.  This  results  in  0 -m.  In  addition, 

1.  (H) 

||m  1.  Consequently,  for  A T/N()— °°  Equation  (3-179)  can  be 

written  as 


Urn 

9 

A T 
N 

o 


A 

m n 


-*£ 


sin  km 


(3-180) 


k 1 


From  the  CRC  tables  | 28,  p.  4(>4)  the  right-hand  side  of  Equation  (3-180)  is 

A 

recognized  as  the  Fourier  series  for  m on  ( 0,  2n  | . Hence,  m— m as 

A“T 
N 


*>,  Equation  (3-179)  is  plotted  in  Figure  3-1. 
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Tho  bias  and  variance  of  m can  be  obtained  by  expanding  the  integrand  of 

Equation  (:»- 1 73>  in  a Taylor  series  about  the  conditional  means  of!  and  g as 

suggested  by  Pnixmlis  | 19,  p.  212|  , Since  the  variance  of  1 and  g approaches 
• ) 

zero  as  A'T/N^  approaches  infinity,  this  approximation  to  the  bias  and 

. A •> 

variance  ot  m is  best  for  large  SNR's,  A“T/No<  From  Papoulis  | 19|  and 
t he  independence  of  1 and  g 


g I m 
(3-181) 

(9-182) 


•» 

,rA  ~ / 

\ 

0 

**  •) 

1 ir  ~ ♦ 

\ 

111  | 111 

o7 

V 

1 E(l|m) 

g E(g  | m)  j 

1 1 m 

ag 

V 

1 E(T  |m) 
g E(g  1 m)  j 
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The  mean  squared  estimation  error  is  given  by 
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Making  use  of  Equations  (3-1(56),  (3-170)  and  (3-173)  in  Equation  (3-182) 
there  results 
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T:ikiiiH  the  partial  derivative  of  ni  with  respect  to  I in  Equation  (3-173)  yields 
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Substituting  Equations  (3- !«;<> ) and  (3- 170)  into  Equation  (3-185)  it  follows  that 
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CHAPTER  IV 
SUMMARY 

1 . 1 Principal  Results 

In  chapter  11,  par.  2.  1,  the  hypothesis  testing  problem 
11  : r (t  > = AS  [ t,  m(t)]  * n (t ) , O'  t -=  T 


11^  : r(t)  = n(t>,  0 t * T 


(4-1) 

(4-2) 


is  considered  where  nit)  is  a zero  mean  Uaussian  process  and  m(t)  and  n(t) 
arc  independent  processes  with  covariance 

Km  (tl’  = E l m(tl'  1 (4“3* 

No 

Kn  (,r  V = E [ n(tj)  n(t2)  J = — 6 ^ 1_t2>  * (4~4* 

Using  the  Karhunen-l.oeVe  expansion,  it  is  shown  that  the  Volterra  functional 
expansion  for  the  likelihood  ratio  is  given  by 

Alr("1-  £ i(f)'  j-f  r, «, t,. 


i=ll 


.It ...  . dt . 
1 1 


(4-5) 


where  the  Volterra  kernels,  f.  (t  ^ t.)  are  expressed  as 


U (tj t.)  - E (s[  t j,  rnttj)]  . . .S  [ t.,  m(t.)l 
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In  par.  2.2,  Equations  (4-5)  and  (4-6)  are  reduced  to  the  well  known 
results  for  detection  of  a zero  mean  Gaussian  process.  In  par.  2.3,  three 
nonlinear  examples  are  presented.  In  the  first  example,  the  first  three 
Volterra  kernels  are  obtained  for  detection  for  a hard-limited  Gaussian 
process.  In  the  second  example,  the  first  three  Volterra  kernels  are  ob- 
tained for  detection  of  the  absolute  value  of  a Gaussian  process.  In  the  last 
example,  a sinusoid  phase  modulated  by  a dc  process  uniform  on  [0,  2w]  is 
considered.  The  likelihood  ratio  is  derived  for  this  example.  For  the 
special  case  gj^T  = nr,  n 4 0 or  w^T  » 1 if  is  shown  that  the  performance  of 
a receiver  based  on  the  likelihood  ratio  is  identical  to  the  performance  of  a 
receiver  based  on  the  trucated  Volterra  expansion  of  Equation  (4-5)  provided 
that  at  least  two  terms  are  used  in  the  expansion. 

In  par.  2.4,  Sun's  theorem  is  used  to  sum  the  series  in  Equation  (4-5) 
for  large  T.  This  is  accomplished  for  the  special  case  where  the  Volterra 
kernels  have  the  form 

f.  (tj. . . , t. ) = K E | S [tj,  m(tj)]  . . . S [t.,  m(t.>]  j , (4-7) 

where  K is  some  constant  independent  of  the  index  i,  and  for  nonlinearities 
S(t, . ) and  processes  m(t)  which  satisfy  Sun's  theorem.  As  an  example,  the 
asymptotic  receiver  is  derived  for  a sinusoid  phase  modulated  by  a first- 
order  Butterworth  process.  The  asymptotic  performance  of  this  asymptotic 
receiver  is  also  obtained  and  compared  with  the  performance  of  a suboptimum 
detector. 

In  chapter  III,  par.  3.  1,  the  problem  of  finding  the  minimum-mean 
squared  error  (MMSE)  estimate 


gfT,  m(T)]  = E | g(T,  m<T)]  | r(t)  ;0s  t ■£  t| 


(4-8) 


is  considered  where  the  observation  equation  is  given  by 


r(t)  = A S [t,  nut)]  n(t). 

I'suig  the  Karhunen-I.oeve  expansion  and  Raves’  law,  it  is  shown  that 
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and  where  f(  (t  j t.)  is  given  by  liquation  (4-0).  It  is  shown  that  Kqua- 

tion  (4-10)  can  be  reduced  to 
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and.  in  general. 
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In  par.  3.2,  Equations  (4-10),  (4-11)  and  (4-6)  are  reduced  to  well 
known  results  for  MMSE  estimation  of  a Gaussian  process  using  linear  ob- 
servations. In  par.  3.3,  Equation  (4-10)  is  used  to  obtain  a stochastic  dif- 
ferential equation  for  the  logarithm  of  the  likelihood  ratio.  In  par.  3.4, 
Equation  (4-10)  is  used  to  determine  the  MMSE  estimate  of  the  square  of  a 
zero  mean  Gaussian  process  using  linear  observations.  This  result  is  shown 
to  be  in  agreement  with  the  work  of  Olsen  [5]  . In  par.  3.5,  Equation  (4-10) 
is  used  to  obtain  systems  of  coupled  nonlinear  differential  equations  for  the 
MMSE  estimate.  Two  examples  are  considered.  In  the  first,  the  Kalman 
filter  equations  are  derived  for  the  MMSE  estimate  of  a first-order  Butter- 
worth  process  with  a linear  observation  equation.  In  the  second,  an  infinite 
system  of  differential  equations  is  derived  for  the  MMSE  estimate  of  the 

square  of  a first-order  Butterworth  process  with  the  observation  equation 
2 

r(t)  = m (t)  -t-  n(t).  In  par.  3.6,  the  MMSE  estimate  of  the  dc  phase  of  a 
sinusoid  is  derived  and  the  estimator  bias,  variance  and  mean  squared  error 
are  obtained. 


-I . 2 Suggest  ions  for  Future  Work 


The  results  of  par,  2.4  apply  only  for  largo  T.  It  has  not  boon  possible, 
howovor,  to  dotormino  how  largo  T must  bo  for  the  asymptotic  results  to  bo 
good  approximations.  A useful  extension  of  the  results  of  this  par.  would  bo 
an  estimate  of  the  length  of  the  observation  interval  required  for  the 
asyniptotio  results  to  apply.  This  might  be  accomplished  for  a particular 
problem  by  a Monte  Carlo  simulation  of  the  asymptotic  receiver  to  obtain 
performance.  Another  interesting  extension  of  the  results  of  par.  2.4  would 
consider  frequency  modulation  of  a sinusoid. 

An  interesting  application  of  the  results  of  par.  2.  1 would  be  found  in 
estimating  the  phase  of  a sinusoid.  For  large  T,  the  Volterra  kernels  in 
liquation  (4-12)  can  be  approximated  by  the  approach  utilized  in  par.  2.4.2 
leading  to  equation  (2-207).  in  principle,  any  number  of  Volterra  kernels 
can  be  approximated  using  this  method. 
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APPENDIX  A 


ASYMPTOTIC  NORMALITY  of  x.  ANI)  Vj 


A.  1 Sun's  Theorem 


I he  asyinptotic  behllvior  of  xj  »nd  are  determined  from  Sun's  theorem  f24] . 
Sun's  theorem  is  stated  as  follows. 

l it  nun  be  a leal,  stationary  liaussian  process  which  is  continuous  in 
the  second  mean,  i.e., 
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-T/2 


is  asymptotically  tiaussian  with  variance 
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From  Fite l son,  f condition  l implies  that  K (T ) is  continuous.  Also,  from 


Fitelson,  [30]  condition  S is  related  to  the  large  frequency  behavior  of  ^m(<vd* 
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t'. 


S ho) 
nr 


1 * (\,  l-'l 


(A  — I > 


where  C'^,  Ct)  > 0 and  a > 1,  then  S*  (uj)  would  satisfy 
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and  condition  8 follows.  In  condition  i),  note  that 
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Thus,  condition  !)  is  also  satisfied  if  Equation  (A— 1)  applies. 

A.  2 Joint  Asymptotic  Normality  of  \,  and  y in  par.  2,4, 3 for 
S ( t,  m(t)|  cos  | u>  t t m(t)| 

In  tliis  paragraph  it  is  shown  that 
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where  i 0,  1,...  are  asymptotically  jointly  Gaussian.  It  is  assumed  that  ni(t) 
and  n(t)  are  independent  zero  mean  Gaussian  processes  with 
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l’irst  note  that  and  j j can  bo  written  as  the  sum  of  two  random  variables. 


Specifically 
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since  the  terms  in  liquations  (A—  1 0)  and  ( A - 1 1 ) involving  n(t)  arc  jointly 
Gaussian  for  i 0,1...,  it  remains  to  show  that  the  first  terms  involving 
m(t)  in  liquations  (A-10)  and  (A— 11)  are  asymptotically  jointly  Gaussian  in 
order  to  show  that  \.  and  y.  are  asymptotically  jointly  Gaussian  for  i 0,  1,  . . . 
By  the  Cramer- Wold  Theorem*  it  is  sufficient  to  show  that 
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aj,...,  a jyj,  then  \j,  i 1,...,  N are  jointly  Gaussian.  See,  for  example, 
[ 1 0,  p.  231,  problem  7-23.1 


is  asymptotically  Gaussian  for  any  arbitrary  a.,  b i 0,  1,...,  N to  show 
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jointly  Gaussian.  Assume  that  the  process  m(t)  satisfies  conditions  (1)  - (3) 
of  Sun's  theorem.  Define  kP.  m(t) ) to  be 
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Observe  that  conditions  (4)  and  (a)  are  satisfied  | condition  (f>)  is  satisfied  since 
K(K  m(t) ) is  bounded  | . Condition  ((>)  is  satisfied  because  the  continuous  and 


bounded  behavior  of  k(K  mp))  guarantees  the  continuity  of  ll^(t,  l0'  for  all  t 
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* Fitelson  has  conjectured,  f 2i>]  in  a similar  context,  that  Sun's  Theorem 
applies  also  for  . 11  rather  than  just  for  the  dense  set  used  here.  This 
dense  set  is  not  very  restrictive  since  L’nM  KT  can  be  made  arbitrarily 
close  to  am  »0  < 11  by  a suitable  choice  of  M and  K. 
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Assume  that  the  spectrum  Sm(u>)  satisfies  conditions  (8)  and  (9).  (Any 
spectrum  satisfying  Equation  (A-4)  will  also  satisfy  conditions  (8)  and  (9).) 
One  example  is  the  first-order  Butterworth  process  for  which 
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whirl,  satisfies  Equation  ,A-t,  by  inspection.  Hence,  it  follows  fr„ra  sun's 


(A-15) 


thooco,,,  that  ZT  is  asymptotically  Gaussian  for  all  a.,!,,,  and  it  follows  from 
the  t'ramer-Wold  theorem  that 
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I cos  1 uM  4 m(t)  J sin  — • t 
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are  asymptotically  jointly  Gaussian  for  i 0,1 n and  N arbitrarily 

latb-c.  but  finite,  and  for  w,  . This  In  tarn  implies  that  x,  and  y,, 

as  ttiven  by  Equations  (A-71  and  <A-8>  are  asymptotically  jointly  Gaussian. 


APPENDIX  B 


VOLTERHA  KERNE  I-S  FOR  A PHASE-MODULATED  SINUSOID 


UP  TO  THIRD  ORDER 


Assn  mo 
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where  m(t)  Is  a zero-mean  Gaussian  process  and 
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By  assumption,  m^  is  a zero-mean  Gaussian  random  variable  with 

probability  density  function 
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where  4>m  (^)  is  the  characteristic  function  associated  with  pfny.  Use  of 
Equation  (B-5)  in  Equation  (B-3)  yields 
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B.  2 Evaluation  of  d,,(tj,  t.,) 

By  definition, 
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Since  nut)  is  a zero-mean  Gaussian  random  process,  m ^ and  m.,  are  zero- 
mean  Gaussian  random  variables  with  probability  density  function 
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and  the  corresponding  characteristic  function  is 
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It  follows  that 
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where  * denotes  complex  conjugation.  Use  of  Kquatioii  (B-131  through  (B-101 

in  liquation  (B-91  results  in 
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Similarly, 
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Substituting  the  above  results  into  Equation  (B-Si,  it  follows  that 
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From  trigonometric  iiiont it los,  Equation  (B-2-J)  becomes 


F,,  F,>  - Fl  (cos  «»  t cos  m - sin  ^ t . sin  m ) 
* - •’  o l 1 o 1 1 


(cos  ^F,  cos  m.,  - sin  u>  ^t.}  sin  m.,1 


(cos  cos  m.j  - sin  ->ot;?  sin  m.jll  (B-25) 

whcic  m.  miF)f  i 1.  3.  Carrying  out  the  products  in  Equation  (B-25)  results 


li3tl  1 ’ *2’  V = cos  Vl  c'OS  ^0*2  oos  ^0*3  K(cos  mi  cos  ni.,  cos  m ) 

* *-  ii 


- sin  -a  t,  cos  t 


’o  1 t-os  J o L>  cos  kJ0t3  F(sin  nij  cos  ni„  cos  ml 


- cos  ^otj  sin  ->ot2  cos  ^ot,?  E (cos  m(  sin  m.,  cos  m^) 

- cos  cos  ui^t^  sin  ^t,}  E(cos  nij  cos  m.,  sin 

* ‘sin  'Jo* i sin  “’o1-*  cos  “>0F?  E(sin  sin  m„  cos  m.{) 


* sin  J0ti  t>os  “>ot2  sin  ^0*3  K(sin  cos  ni.,  sin  m.,t 


f t>OS  “V,  sin  ^2  Sln  u,0t3  K(cos  mi  sin  mo  sin  ni.?t 


- sin  ^ot  j sin  sin  u>^3  E(sin  nij  sin  m„  sin  m l . 


(B-2(>  > 


Note  that  the  joint  probability  density  function  of  in  m.)t  ami  m.  is 

l — 3 


1 -1  1 

2 <ml  m2  nV  Kml  ni„ 


P(m,.  m m i = ^ 

(I’*)  “|K  ! * 

ni 
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As  a result, 

t'B-30) 

can  be  written  in  the  form 

K(cos 

m^  cos 

1 -7  [R^r  t,)  +Rd  t )^R(t 

m0  cos  nig)  = — e “ “ J 

+ 2H(tr  t2) 

+ V 

1 + 2R(t2,  t3)] 

- f [ R (t  i , 

+ e 

- tj)  + R(t2, 

tg)  + Rftg,  tg 

+ 2R(tr  t2) 

- 2R(tr  tg] 

1 ■ -^(tg,  tg)  ] 

- i [ Rft 

+ e 

4)  - R(t2, 

V + R(t3’  V 

- 2R(tv  t2) 

+ 2R(tr  V 

-2R(V  V1 
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- e 

V + R(t2, 

t2)  + R(tg,  tg) 

- 2R(tr  t2) 

- 2R(tr  V 

+ 2R(tg,  tg) 

+ e 

V + R(t2. 

t2)  + R(t3’  t3) 

- 2R(tr  t2) 

- 2R(tr  tg) 

+ 2R(t2,  tg)] 

- i iRft  . 
+ e 

V + R(t2, 

ty  +R(tg,  tg) 

- 2R(tr  t2)  + 2R(tr  tg) 

- 2R(t2,  tg)] 

-i  fRCt 
+ e 

+R(t2, 

tg)  + R(tg,  tg) 

+ 2R(tj,  t2)  - 

■ 2R(tr  tg] 

- 2R(tgf  tg)  ] 

+ e 

tj)  + R(t2, 

tg)  4-  R(tg,  tg) 

+ 2R(t  t0)  4 

• 2R(t  , t_) 

+ 2R(t„.  t0)  ] 1 

t'pon  simplification,  (H-311  lie  comes 


K(cos  m cos  m„  cos 
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In  a similar  manner,  if  is  found  that 


l\(COS  111 

, cos  m„  sin  ni.,l 

1.  1) 

1 <J»(1, 

-1.  11  • «H-l, 

1.  11 

* -1 

. 11  - 

•Ml. 
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- 
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sin  m„  cos  m l 

0 . 
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!•  (sin  in 

sin  m„  sin  m l «■ 

0 , 

(11-3(11 

K(cos  m,  sin  m„  sin  m ) 


l(sin  m,  cos  ni,,  sin  m.,i 


K<sin  m sin  ni„  ow  in 
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" 4 e “ 
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r 
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o 
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Use  of  the  above  in  (B-26)  yields 
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Equation  (B-40)  can  be  simplified  by  noting  that 

cosh  a cosh  b cosh  c - sinh  a sinh  b sinh  c 

1 r,a+b+c  a + b-c  a-b+c  a-b-c  -a+b+c 

= 8 (e  +e  +e  +e  +e 

-a  + b-c  -a-b  + c -a-b-c , , a + b + c a + b-c 

+ e +e  +e  )-(e  -e 

a-b+c  . a-b-c  -a  + b + c -a  + b-c,  -a-b  + c 

-e  +e  -e  +e  +e 

-a-b-c, , 

- e )]  . 

This  simplifies  to 

cosh  a cosh  b cosh  c - sinh  a sinh  b sinh  c 
1 i a + b-c  , a-b  + c,  -a  + b + c -a-b-c 


+ e 


+ e 


+ e 


1 . 


(B— 41 ) 


Comparing  Equation  (B-41)  with  the  first  group  of  terms  in  Equation  (B-40), 
where 

a = R(tj,  t2) 
b = R(tr  t3) 

C = R(t2,  tg)  , 
it  is  observed  that 

i r-R^r  t2)"R(ti*  t3,~R(t2’  t3)  “R(tr  t2)+R(tr  V + R(V  t3) 

4 Le  + e 

+ e+R(tl>  t2)  ' Rftl>  t3)  + R(t2*  t3)  + e+R(tl’  l2}  + R(tv  t3)  - R(t2-  43>j 
= cosh  f R (t j , t2)]  cosh  (R(t1,  tg>]  cosh  [R(t2>  tg)] 

- sinh  [ R(tj,  tg)l  sinh  [Rftj,  tg)]  sinh  [R(t2,  tg)]  . (B_42) 


B-ll 


Similarly, 


cosh  a cosh  b sinh  c - sinh  a sinh  b cosh  c 


1 i,  a+b  + c a + b-c  a-b+c  a-b-c  -a+b+c 
- £■  I (e  - e + e -e  +e 

-a  + b-  c -a-b  + c -a-b-c,  , a + b + c a+b-c 

-e  + e - e )-(e  +e 

a-b+c  a-b-c  -a+b+c  -a+b-c 
-e  -e  -e  -e 

-a-b  + c -a-b-c,, 

+ e + e )] 


1 , a + b-c  a-b  + c -a+b  + c,  -a-b-c, 

= " 4 le  - e -e  +e  I . 

Hence,  the  fourth  group  of  terms  in  Equation  (B-40)  may  be  expressed  as 


(B-43) 


l (""R(tr  V _ R(tr  S' _ R(S*  S'  ~R(ti»  S' + R(ti*  S' + R(S*  S' 

4 1°  - e 

+R(tr  t2)  - H(t1,  t3)  + R(t.„  t3)  +R(tj,  t„)  + R(t  , t ) - R(t9,  t )] 

- e + e ; 

= cosh  [ R(tj,  t,,)]  cosh  [ R(tj,  tg)]  sinh  [R(t.„  tg)] 

- sinh  I R (t  j , t2)]  sinh  [R^,  tg)]  cosh  |R(t9,  tg)]  . (B-44) 


Redefining  a,  b,  and  c as 
a = R(t2,  tg) 


b = R(tr  t2) 


c = R(tj,  tg)  , 


B- 12 


The  third  group  of  terms  in  Equation  (B-40)  become 


1 r_R(tr  t2) ' R(ti*  t3) " R(S*  t3)  " R(tr  S'  + R(tr  t3)  + R(t2’  t3) 

4 L ® 

+ R (tj,  t2)  - R(tj,  t3)  + R(t2,  t3)  + R(tv  t2)  + R(tr  t3)  - R(t2,  t3)J 


+ e 


= cosh  I R(t1.  t.,)]  sinh  [R(tr  tg)]  cosh  [R(tol  t )] 

- sinh  [ R(t  , t )]  cosh  [ R(t  , t )]  sinh  |R(t  t.)J  . 

A i o £6  (B-45) 

Similarly,  the  second  group  of  terms  in  Equation  (B-40)  may  be  expressed  as 

/ R(tr  v - R(tr  S'  - R<S’  S'  ■ R(ti>  S'  + R(tr  S'  + R(S>  S' 


4 L' 


+ e 


* R(tr  S'  “ R(tr  S'  + R<S’  S'  + R(tr  S'  + R(tr  S'  ~ R<S*  S'l 

- e - e I 

= sinh  [R(t1,  t2)]  cosh  [Rflj,  t3>]  cosh  [R(t.„  t3>] 

- cosh  [R(t  t )1  sinh  (R(t  , t )J  sinh  (R(t_,  tQ)}  . 

1 jo  ^ o (B-4G) 
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From  the  above  results  it  is  concluded  that 


d rt  t t \ = 2 tl>  +Rm(t2*  t2)  + Rm(t3*  t3)  1 

a3'll*  l2’  l3*  6 

(cos  cos  uot2  cos  “0t3{cosh[Rm(tr  t2)l  cosh[Rm(tr  t3)]  cosh[Rm(t2,  t3)l 

- sinh[Rm(t1>  t2)]  sinh[Rm(tlf  tg)]  sinh[Rm(t2,  tg)  ] } 

+ sin  sin  uQt2  cos  "^{sinhfR^,  tg)]  coshfR^,  tg)]  cosh[R(t2,  tg)l 

- cosh  [Rm(tr  t2)]  sinh[Rm(tr  t3)l  sinh[Rm(t2,  tg)  ]} 

+ sin  cos  u>ot2  sin  «otg{ cosh[Rm(t1.  t2)]  sinh(Rm(t1,  tg)]  coshlRm(t2>  tg)] 

- sinh[Rm(t1,  t2)]  coshlRm(t1,  t3)l  sinh(Rm(t2,  tg)]} 

"cos^tj  sinwot2  sin  u)ot3(  cosh!  Rm(tr  tg)]  coshlR^,  tg)]  sinhlRm(t2>  tg)] 

- stah[Rm,tr  t2)|  Sinh[Rm(tr  t3))  cosh[Rm(t,,  yl})  . (B _4?| 
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11- A'  KFGF1YFH  RMi  A NONZKHO  MKAN  GAFSSIAN  l’RGKTESS 
G.  1 Receiver  1 V rivation 

Consider  the  hypothesis  testing  problem 
H jt  r(t)  s(tl  * n<t > ; 0 < t ^ T 

»1():  >'(*>  n(t) 

where  s(t»  and  n 1 1 ) are  independent  Gaussian  proeesses  with 

Kl  * (* x >.  « (to)  I Ks  (tr  t„) 

N 

I ~ - t.,1 

E(  n(t>  | 0 


1 he  low  energy  coherence  (I.Kt'l  condition  is  f 2,  p.  :u] 
N 

\.  v.  -£ 


(G-31 


where  the  eigenvalues,  \jf  and  eigenfunctions,  0 at)  are  solutions  of  the  integral 


equation 


Ai  V1!1  J Ks  (,r  '•»> 


(G-ti 


From  Van  Frees  [2,  p.  11,  Equation  (lib]  , the  logarithm  of  the  likelihood  ratio  is 

•O  .m 


( n A (i  (t) ) 


fE-Vv*E-Vvt 


° i 1 X,  * f 
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1 V*  1 2 1 
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where 


T 

ri  = f r(t)  0j(t)  dt 
0 

T 

=A/  E [ s (t)  J 0i(t)  dt 
0 

Equation  (C-5)  may  be  rewritten  as 


(C-6) 


(C-7) 


I* sing  Taylor  series  expansions  for  both  (1  *-  2\.  and  Mi  (1  ♦ 2\.  N^)  and 

returning  terms  up  to  order  - \.  in  Ki]imtion  ((.  -8),  the  logarithm  of  the 


likelihood  ratio  simplifies  to 


fa  A (r(t) » 


I (fT  E \ v 


•f  E-, 


r L '-n;  ri 

O . , \ O / 
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From  Equation  (C-lO)and  the o rthogonality  of  the  eigenfunctions  <i> (t)  on 
l 0,  T ) it  follows  that 

» '1'  T 

Y XiriJ  / / r<V  r<t2)  Ks(tr  t2)  dt1  dt2 

i 1 0 0 

T 

Y ''j  rj  f E[s(t)]  r(t)  dt 

i 1 0 

T T 

Y J J El  8(^)1  r(t2)Kg(t1>  t2)dtj  dt2 

i 1 0 0 

oo  T T 

Y v / f k2[  s(t)i  dt 

i 1 0 0 

T T 

Y \\  j I El  8(1,11  E[s(t2)l  Ks(tr  t2)  dtx  dt2 

i = 1 0 0 

00  T 

Y \ I t]  dt  • i 


With  the  aid  of  Equations  (C'-ll)  through  (C-1(J),  Equation  (e'-9)  can  be  expressed 


in  I 


\ (r(t) ) = 


2 T T 

I (if ) / / r(tl)r<9  Ks(tl>  9*1 


dtr 


0 0 


1 

if-  f E|s(t1)j  r(t  ) dt 


T T 


»r)  j / E l s (tj)  J r(t2)  Ks(tr  t2)  dt1  dt2 


0 0 
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" ^ (if")  f E2  l s (t)  J dt 
V °‘  0 


T T 


2 j J"  ^ I s ^9  1 ^ I s t^)  ^ Ks  9 *1 


dtr 


0 0 
T 


' Hrf)  / Ks,trti)dti 


(C-17) 
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Focusing  attention  on  those  terms  in  (C- 17)  involving  the  observation  r(t),  it 
clear  that  the  LEC  receiver  is  given  by 
2 T T 

I (if)  / /r(tl)r(VKs  (tl*Vdtl  dt2 


+ Nq  f r(tl)  ] Efs^ti)J-  f dt2  | dti  > y (C-18) 

° ° ° o ) h 

0 

where  y is  the  threshold. 

In  Section  C.  2 a case  of  interest  is  considered  for  which 
T 

J Ks  ^tl’t2)  dt2  iS  with  respect  to  E[s(tj)]  . Let 


y1  (tx)  = Efsftji] 

T 

W = E[s(tl)]  -JL  y E[8(t2)]  Ks  (t2.tl)  dt2  . 

° o 

Define  the  norm  of  a signal  y (t)  to  be 

H y II  f y2(t)dt . 


(C-19) 
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It  follows  that  the  squared  relative  error  between  y ^ (t ^ ) and  y2(t2)  is  given  by 


TFT 


o^-l  I E[s(t  )]  K (t0,t, 

.a  /"w-wm  ° „ Lo  2 8 2 1 

\ "yjftj)"  ; t ~~ 
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( “«1  implies  that  y (t _ > is  "close"  to  y <t  ^ ) in  a squared  error  sense,  or,  that 
T 

/ K[s(t,,)]  Kg  (t0,tj)  dt  j is  negligible  with  respect  to  E[s(t^)]  . For  the  case 
o 

considered  in  paragraph  C.2,  it  is  shown  that  t “ « 1. 

The  LEC  receiver  then  becomes 
„ T T 


f(ir)  Jf  r(ti)r<t2>  Ks  <VV  dti 
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— f r (t  t > E [ s(t  )]  dtj 
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C.  2 Justification  of  I.EC  Receiver  Interpretation  in  Par.  2.4.3 

In  par.  2. 4. 3 S(t,  m(t))  = cos  (a>0t+Tn(t)) . From  Equations  (2-209)  and 

(2-210),  the  mean  and  variance  of  the  equivalent  Gaussian  random  process, 

s (t ) = AS(t,  m(t)),  used  in  determining  the  asymptotic  performance  of  the 

asymptotic  receiver  are  given  by 
__P 

E[s(t1)]  = A e " cos  flDc)t1 
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With  respect  to  (C  — 1 8) 
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j E[s(t2)]Kg(t2,t1)dt2»^-  J [cosh  (Pe~°  'tl_t2,)-l]  dtg  cos  (C-24) 
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where  the  contribution  from  the  double  frequency  terms  is  recognized  as  being 
negligible.  Expanding  cosh  (• ) in  Equation  (C-24)  obtain 
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Similarly,  J exp(-Pe  ° (l  '-  ) dt9  is  obtained  by  changing  the  sign  of  P in  the 


above  result.  Consequently, 
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Also,  with  respect  to  Kquation  (C-22) 


(C-2G) 


Substitution  of  Equations  (C-25)  and  (C-26)  into  Equation  (C-22)  results  in 


C-9 


Observe  in  Kquation  (C-27)  that 


-P 

e 


-1)  < 


1 . 


(C-28) 


It  is  concluded  that  the  inequality  in  Equation  (0-22)  is  easily  satisfied  provided 
o 

« 1.  This  is  the  case  which  is  considered  in  par.  2.4.3.  where  use  is 
o 

made  of  the  LEO  receiver  given  by  Equation  (0-23). 

0 . 3 Rece i ve r Pe r for  mancc 

The  receiver  performance  presented  here  follows  the  development  given 
by  Van  Trees  [2]  . 

0.3.  1 Phernoff  Approximnt ion 

l’he  Chernoff  approximation  to  receiver  performance  was  first  introduced 
by  Oollins  [31].  If  t is  the  logarithm  of  the  likelihood  ratio,  the  false  alarm 
probability  is  given  by 


PFA  = / Pt  IIP  <L'V  d h (C-29) 

y 

while  the  detection  probability  is  given  by 


PD  = j p(  ||,  (IWHj)  d L (0-30) 

y 

where  P^  ^ (I, 'll.)  is  the  conditional  p.d.f.  of  ( conditioned  on  IE.  In  \’an 
Trees  [l]  it  is  shown  that 


>,  ,Hi  (MHj)  = 


e1,  P 


(0-31) 


10 


^ 


The  moment  generating  function  of  f,  conditioned  on  H(r  is 


Now  let 

fz(S)=/n(</>  (SM 
0 

and  next  define  a tilted  random  variable  x with  pdf 


sx 


I’x  <X) 

■ s 


* PMH„  <X'"(>> 

00 

/ eS1  *’<  m0(LIHoldI- 


= eSX-p(S) 

( m (A,,V 


From  Equations  (C-341  and  (C- 2D) 

= f^-SX  (X)dx 

J s 


FA 


Equation  (C-35)  may  be  rewritten  as 


, p(S)-Sy  f S(y-X) 

EA=e  J 0 Pxs  (X)<1X 


Before  proceeding,  note  that 


K<v 


/X,- 


,’(in0<xl,V  ,K 


Pf -H0  <Lfll0>dlj 


(C-321 


(C— 33) 


(C-34) 


(C-35) 


(C-3f>) 


(C— 37) 


C-ll 


It  follows  from  Equations  (C-37),  (C— 32)  and  ((.  -331  that 


E<V  = d^  = ■ 

Similarly, 


ox  = M (S)  • 


(C-38) 


(C-39) 


A standardized  random  variable  is  now  defined  as 


- M (SI 


(C-40) 


In  the  Chernoff  bound  one  chooses  s so  that 

M (SI  = y . <C"41> 

With  the  aid  of  Equations  (C-41),  (C-36)  and  (C-40),  the  false  alarm  probability 

is  expressed  as 


. /n — — 

= eM  (S)  - S M (S)  r e-S  VM  (S)  Y (y)  dy 


(C-42) 


Expand  1’  (Y)  in  an  Edgeworth  series  to  obtain 

"a  m 

P (Y)  = <t>(\)  -~rfr  0 (Y) 


£ *<4’  (V, 


where 


Ho  = 1 

H j (Y)  = Y 

«2  (Y)  = y2-i 

11.,  (Y)  = Y3-3Y 


1(kv3  , (6) 

— * 


(C-43) 


(C-44) 


C-12 





(C-45) 


and 


(n) 

cv  = 


n n 9 

(p(S)l  “ 

Writing  out  the  firs!  two  terms  of  the  Edgeworth  series  it  follows  that 


/ e-s  ^ Y pv<y>  .1  V 


V 


J_  r t.-SVi.-(SIYe-Y-/2dY 
2tt  J 


jl£1 


fi(p  (S>  > 


:t  2 


I_  /^-sVcPI  Ye-Y2'2dy 

2rr  -/ 


/Y 


(C-46) 


At  this  point  it  is  convenient  to  define 


v r 

,,,  1 /"  ..n  — /i  x -x‘ 

(d  > = I x e e 

v'  2tt  •/ 


dx  . 


(C-471 


Integrating  Equation  (C-47)  by  parts,  there  results 


ln  = t"-1'  'n-2(,i)  " /?  1 (,n 


(C-48) 


C- 13 


Note,  by  direct  integration,  that 
, 2/2 

( ? ) = c 1 erfc*  (8  ) 

2 9 

I (in  = - de~,{  erfc*  (d ) 

1 


whore 


erfc*  ((?  i = 


OO  __  •* 

-L_  f e 2 dx 


Using  the  recursive  result  of  Equation  (C-4S) 


° 2 
o t .i  3 it  / 2 

1,(31  = ~ — -(d  4 3d)  e erfc*(dl 

^ 2ff 

Identifying  8 with  S /.« (S > , it  follows  that 
j o-S^Y  Py,Y,dY 

O 

S2  /t'(S)  

= e “ erfc*  (sVm(S)I 

, *<(*> 

«<A'( S»3  2 


-s\v(sn3  2e 


erfc* 


(C-49) 


(C-50) 


(C-51) 


(C-52) 


(0531 
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From  Equations  (C-53)  and  (C-42),  the  false  alarm  probability  is  approximated  as 

n - QP(S)-Sp(S)+S  p(S)/2  . „ „ i'rT~r 

FA  ~ e erfcMSVM(S)) 


...  3 

P(S1S  _m(S)-Su(S)+S  u(S)/2  , ,^T— 

- ^ e erfc*  (S  v/j (S>> 

_ ep (S  )-Sp (S ) 

6(/<’(S))3  2^2r 

where  lkS<  1 and  is  chosen  so  that  p (S)  = y 

From  Equations  (C-31)  and  (C-34),  observe  that 

P(|H,  <XIV  ’ e-<S-1,X’«S'  ly  (X> 

l s 


(C-54) 


(C  —55 1 


Use  of  Equations  (C-55)  and  (C-30)  result  in  the  detection  probability  being 
expressed  as 


p>  = 1 _ CP(S)+(1-S)P(S)  J e(l-S)Vp(S)  Y 


D 


P (Y)  d Y 


(C-56) 


In  a manner  similar  to  the  development  of  Equation  (C-54)  from  (C-42),  it  can  be 
shown  that  Equation  (C-56)  can  be  written  as 

PDI  l.e^Hd-SVP.Kl-S.VcSI  = erfc.|(1_S)V^, 


er(c-[(l-S,v^S] 


. P(M(1-P(S)(1-S)  ) p(S)  nl-S)p(S) 

~ 372 
fi  v'Stt  (/.<  (S)) 


(C-  57) 


where,  as  before, 0 - S-  1 and  is  chosen  so  that  p(S)  = y 


C-15 


C.3.2  LKC  Approximation  for  p(S) 

From  Van  Trees  [2,  p.35]  a simple  expression  for  p(S)  can  be  obtained  for 
the  LEC  case. 


m(s)=i  X! 

i=  1 


2A.  \ / 2(1-S)\ 

(1-S)  <n(l  + -fn(l  ^ — 

o'  ' o 


*1 


s y' 

2 Z-»  N,  / + \ 


0<S<1 


(C-58) 


1=1  ‘ o/2(l-S)  1 

Denoting  the  first  term  in  Equation  (C-58)  as  p^(S)  and  the  second  as  n^(S),  note 
that 


fR's' : I £ 

i=l 


\ 

2 

1 

2 

/ 2 \ , 2 ^ 

(1-S) 

N 

o 

li  ~ 2 

k)  ** 

• 

(if) 

o \ o / 


1 


. (C-59) 


Because  of  the  LEC  assumption  it  is  necessary  to  retain  terms  only  up  to  order 
/ 2\.  \ 2 

( — - 1 (since  the  linear  terms  cancel).  Hence,  for  the  LEC  case 
VNo  / 


T T 


U (if)"  //C-V 


2)  dtj  dt2 


o o 


(C-60) 


Similarly, 


° 2 


1 - 


2X.  (1-S) 
N 


+ . . 


(C-fil) 
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2A. 


Retaining  terms  only  of  order  in  Equation  (C-Gl),  there  results 

o 


VS) 


~ -S(l-S)  1 _2_ 


N 


J E2  f s({|]  dt  - (1-S 


S) 


T T 


/ J E[  s(t  j)  ] E[s (t2>  ] Kg  (tj,  t2)dt1  dt 


2 f • 


o o 


(C-62) 


It  follows  from  Equations  (C-58),  (C-GO)  and  (C-62)  that 


M(S)  =*  pR(S)  f Md(S) 


(C-63) 


C . 3.  3 Evaluation  of  p(S)  as  Required  in  Par.  2.4.3 
From  par.  2.4.3 


Ets(t))  = Ae  “ cos  cn  .t 


o 1 


(C-64) 


and 


Kg  (tlft0)=  A“  e 1 | [cosh  (Pe  ° **  t2*)-l]  cos^ptj^  cos 


+ sinh  (Pe  " ^ * *2 


) sin  fu  t.  sin  ai_t 


i - oui  n i,, 

o 1 o 2 


} 


(C— 65) 


Consequently 
T T 


j j Ks2  <tl*t2)  dtldt2 


o o 


A404~lT“  ‘ ~ 2 / / [cosh  (2Pe-<v,tl-t2!)-2  cosh(Pe~£V,tl-t2U 


T T 


dt  j dt0 


o o 


(C-GG) 


where  double  frequency  terms  have  been  ignored. 


1 


4 


■ 


C- 17 


To  perform  the  integration  in  Equation  (C-66)  consider 


T T 


■ 


2 * 

(jr)  / y K[s (t i>]  E[s(t2)]  Ks(tr  t2)  dtj  dt2 

o o 

T T 

31  (jf")  A4  e-"1  • i j f [cosh  dt}  dt9  (C-73) 

o o 

where  double  frequency  terms  have  once  again  been  ignored.  Use  of  Equation 
(C-f>9)  in  Equation  (C-73)  results  in 

2 } T 

(if)  / / E[sM  E[s,t2)]  Ks(tl,t2)  dtl  dt2 


A 1 -2P 

No)  e 

o / 


E lir  " 


-2iaT, 


(C-74) 


Hence,  from  Equations  (C-74),  (C-72)  and  (C-6?) 


VS)  = 


e“PoT  - (1-S)  (1~ \ e' 
No°  IN  Qa 


2 

EP  qT 
2 i i 


,i  -2ioT 
1-e  ) 


(C-75) 


Adding  /u  ^(S)  and  ^^(S)  it  follows  that 


d(S)  = 


1 rS(l=S )(  ( A2  \ -2P(  1 V^12P'2'  F cT  (l-e~2iQT) 

2 \VNoft/  6 ) 2 Lj  2 i’.  i 2i2 


. -2ioT 

l-e  ) 


(v) 


e"P  oT  ) . (C-76) 
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APPENDIX  D 


1'HF  LEC  CONDITION  FOR  NONSTATIONARY  PROCESSES 


D.  1 Derivation 


Consider  the  integral  equation 
T 

(tjl  = I K (tj,  t0>  6 (t0>  dt0 


(D—  1 ) 


where  A.  is  an  eigenvalue  and  cut)  is  an  eigenfunction  associated  with  \ The 

1 i* 

low  energy  coherence  (LEC)  condition  applies  if  [2] 

N 

i \ 1 _2 

MAX  <<:  2 (D-2) 

where  I *MAX'  is  the  modulus  of  the  largest  eigenvalue  and  ^2  is  a white  noise 
It  Kit^.t.^l  is  an  autocovariance  for  a stationary  process,  the  eigenvalues 
can  be  bounded  by  the  maximum  value  of  the  spectrum  [l] . It  is  then  easy  to  see 
whether  Equation  (D-2)  applies  without  actually  solving  Equation  (D-1)  for  the 
eigenvalues.  Unfortunately,  no  simple  technique  for  determining  a tight  bound 
°n  ^ MAX  iS  avni'a^'e  when  Ettj.to'  is  an  autocovariance  for  a nonstationarv 
process.  The  purpose  of  this  appendix  is  to  provide  a technique  for  determining 
a tight  bound  on  \ ^ ^ for  the  more  general  nonstationarv  case. 

Let 

K(tr  t2)  - K(tj, tg)  = Eitj.tj,)  (D-3) 

where  Kitj.t^)  is  an  autocovariance  fora  stationary  process.  From  Equations 
(D-1)  and  (D-3) 

T T 

\^(tj)  -J  E(trt2)  o,t,t  dt  2=J  Kttj,  t2>  <^(t0)dtn  . (D-4> 


D-1 
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Let 


5(tx)  = / E(trt2)  <p(t2)  dt2. 


P-5) 


Following  the  development  leading  to  Equation  (C-221  it  follows  that  if 


1.  X 

j e2(t1)  dtj  «X2f  ^(tjJdtj 


P-6) 


then 


X 

\ 0(tj)  - / K(tj,  tg)  0(t2)  dt2 


P-7) 


Consequently,  the  eigenvalues  and  eigenfunctions  associated  with  K(t^,  tg) 
approximately  satisfy  Equation  P-7)  and  K(tj,t2)  can  be  used  to  obtain  approxi- 
mate values  for  A.  provided  that  Equation  p-6)  applies.  From  Equation  p-6) 


P-8) 


T 

T 

r i 

1 

2 

/ 

e2(tj)  dt x = y 

/ ^rV  0(t2)dt2 

dtj  . 

o 

o 

L ° 

J 

Use  of  Schwartz's  inequality  in  Equation  (D - 

8)  results  in 

T 

T 

T 

T 

/ 

e2(tj)  dtj  s f 

/ E\  V<*2 

/ 

dt2 

0 

o 

o 

_ 0 

. 

dtf  . 


P-9) 


However,  the  eigenfunctions  have  unit  energy.  Hence  Equation  p-6)  is  applicable 
provided 

T T 

O O 

p-10) 


/ j E2(trt2)  dtx  dt2<<  X: 


o o 


D-2 


Itecall  (hut  ( 1 1 


I*  T 

XMAX  'll  ,'VK(trt2lf(Vlltl,ll2 

i>  o 

wht'iv 

T 

f f"l«  *M,  - >• 

o 

Hence,  Kquatlon  <1  >-t»>  i.s  satisfied  for  the  Impost  eigenvalue  if 
T r 

I J ‘K,  «M2 

o o • 

5 <-<-  l 

- .j.  v 

I j r<t  t2*fit2»  ««j  i«2 

o o 

where  f(tl  satisfies  Kquatlon  (0-12) 

The  procedure  for  obtaining  an  upi»er  hound  on  \ the  largest  eigenvalue 

associated  with  K(t.,t„).  is  as  follows: 

1.  (.liven  K(t  j,  tni,  t'ormulute,  by  trial  and  error,  a covariance  function  of 
a stationary  process,  K (t  ^ , t , for  which  the  inequality  in  Kquatlon 
(0-  13)  is  satisfied, 

2.  Having  found  a suitable  Kdj.t.,1,  determine  an  upper  bound  on  the 
largest  eigenvalue  associated  with  K(tj,t0). 

It.  This  upjH'r  bound  is  used  as  an  upper  bound  for 
Observe  that  the  inequality  in  Kquatlon  (U-131  may  be  satisfied  only  for  a limited 
range  of  parameter  values  associated  with  the  random  process.  The  upper  bound 
Is  then  valid  only  for  this  restricted  range. 


(D-ll) 


(0-121 


(0-131 


0-3 


D.  2 


Calculation  of  Region  for  Which  the  LEC  Condition  Applies  in  Chapter  II 


Par.  2.4.3, 

In  this  paragraph 

"m'VV  - 

AS  [t,  m(t)]  = A cos  [o30  t+m(t)]  . 

From  Appendix  B 

A dl^l*  = AE  ^ } = Ae  P//2  cos  o^tj 

a2  d2(tr *2) = a2e  <Sftl'  mM  Sft2*  i 

= A2e  P £ cosh  *2I)  C08  (DQt^  cos 

+ sinh  (Pe-0  ^ *2^)  sinai^j  slna^t,,  J . 

Let 

K(trV  = a2  fd2^r  V " di(ti)  diM 

= A e PJjcosh  (Pe~°  **  cos  cc0tj  cos  a>Qt2 

+ sinh  (Pe-0^1  t2^)  sinajQtj  sin  a>0t2  j . 

Through  a process  of  trial  and  error,  K(t1,t2>  is  chosen  to  be 

K(t,.t2>- A2  | [ «p(Pe-“l,l-*2l)-l]  cos  a.0C»1-t2)  . 


(D-14) 

(D-15) 

(D-16) 


P-17) 


P-18) 


P-19) 


Recall  that 

T T 

T T 

//' 

o o 

b’2(tl,t2)  dtl  dt2  = (K<ti.t2)  - K(ti.t2)>2  cttj  dt 2 • 

o o 

(15—20) 

From  Equation  (D-18)  - (D-20) 


T T 

o 1 ”2P 

E (t,.t2)  dtj  dt2  - A**  ^ 

T T 

II' 

f f ( 2 oxp  (-2Pe"<>:'tl"t2l) 

o o 

o o 

- 

4 exp  (-Pe^,trt2l) 

♦ 

2)  dt,  dt. 

(D-21) 

where  double  frequency  terms  have  been  dropped  since  they  contribute  negligibly 
to  the  integration.  From  Equation  (C-67)  and  Equation  (D-21) 


in  Equation  (D-13)  let 

f(t)  = cos  ,oot  . (D-23) 

It  follows  that 


T T 

//  fftjl  Kftj.  t2>  f(t2l  dt,  dt2 
o o 


o 

* A~ 


o 

*• 

T 


j j"  0 * (t,0i*h  *2^  -1) 

o o 


dtl  dt2 


(D-24) 


D-5 


where,  once  again,  double  frequency  terms  have  been  dropped.  The  right  side  of 
Equation  (D-24)  can  be  expanded  so  that 
T T 

//  f(tx>  K(trt2)  f(t2)  dtx  dt2 
o o 

^A2:L  jj  e~P  ^ exp  (Pe~<v,tl~t2l>  | exp  (-Pe"^*!-^1) 
o o 

(D-25) 

From  Equations  (D-25)  and  (C-67) 

T T 

II  fftj)  K(t1#  t2)  f(t2)  dt1  dt2 

o o 


- 


dtl  dt2 


.22  e 

ar  A — • — 

T 4 


'P,VP 21  / 1 (l-e~2laT)  \ 

2hw (3OT-wJ)  • 


(2ioT) 

With  the  aid  of  Equations  (D-26)  and  (D-22),  Equation  p-13)  becomes 

.i,„i 


P-26) 


E(-P)‘(2-2)  ( 1 (l-e“laT)\ 


p2i  / j 

2^ nr  ( k7f 

^ i=l  \ 


2(l-e~21aT) 

(2loT)2 


)) 


«1  • 


(D-27) 


The  random  process  parameters  of  interest  are  P and  aT.  Note  that  increasing 
P decreases  the  left-hand  side  of  Equation  p-27)  while  increasing  oT  increases 
the  left-hand  side  of  Equation  (D-27).  The  left-hand  side  of  Equation  (D-27)  is 
plotted  in  Figure  D-l  for  representative  values  of  P and  cvT.  Only  values  of  P 
and  oT  for  which  Equation  p-27)  is  satisfied  are  considered  in  Chapter  II 


par.  2.4.3. 


Figure  I)-l. 


versus  o T parametric  in  y/\ 


The  power  spectral  density  associated  with  Ktfj.t,,)  is 


S (ail 


J e T A2  [ exp  (Pe""’1 ')  -1  J 


cos  aj  t dr  . (R-28) 

o 


Expanding  the  exponential  in  Equation  (P-28)  and  performing  the  integration 
results  in 


9 

A~  -P 

/ in 

, 1(1  > 

— e 

I 2 

2,2,  2 

MV 

1=1 

Y ( i<»  > *■  (a>-ro0) 

(to)  * (a>*ti>0l  y 

(D-29) 


The  peak  of  S (ail,  assuming  «<<•  aiQ.  is 


!S  (col 


MAX 


9 tV  i 

_ a:  -p  p_ 

2o  i'.i 


(P-30) 


i=  1 


N 


The  l, EC  condition  applies  provided  ^ lai)  ^ *-<r  — . Consequently,  it  follows 
from  Equation  (P-30)  that  the  l.EC  condition  applies  if 


A“  -P 

N a e 
o 


Ei_ 

i'.i 


1. 


(P-31) 


i=  1 


The  inequality  in  Equation  (P-31)  is  satisfied  throughout  Section  II  par.  2.4.3. 
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